-- Logs begin at Tue 2022-06-28 16:57:18 UTC, end at Tue 2022-06-28 18:04:33 UTC. -- Jun 28 17:31:32.528922 dv-cinder-848013-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 28 17:31:32.537978 dv-cinder-848013-1-smb devstack@keystone.service[86673]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 17:31:32 2022] *** Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: nodename: dv-cinder-848013-1-smb Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: machine: x86_64 Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: clock source: unix Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: pcre jit disabled Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: detected number of CPU cores: 4 Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: current working directory: / Jun 28 17:31:32.540845 dv-cinder-848013-1-smb devstack@keystone.service[86673]: detected binary path: /usr/bin/uwsgi-core Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: your processes number limit is 47680 Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: your memory page size is 4096 bytes Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: detected max file descriptor number: 2048 Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: lock engine: pthread robust mutexes Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: thunder lock: enabled Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 28 17:31:32.541470 dv-cinder-848013-1-smb devstack@keystone.service[86673]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 17:31:32.590512 dv-cinder-848013-1-smb devstack@keystone.service[86673]: Python main interpreter initialized at 0x5641e51569c0 Jun 28 17:31:32.590512 dv-cinder-848013-1-smb devstack@keystone.service[86673]: python threads support enabled Jun 28 17:31:32.590512 dv-cinder-848013-1-smb devstack@keystone.service[86673]: your server socket listen backlog is limited to 100 connections Jun 28 17:31:32.590512 dv-cinder-848013-1-smb devstack@keystone.service[86673]: your mercy for graceful operations on workers is 90 seconds Jun 28 17:31:32.591011 dv-cinder-848013-1-smb devstack@keystone.service[86673]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 17:31:32.591129 dv-cinder-848013-1-smb devstack@keystone.service[86673]: *** Operational MODE: preforking *** Jun 28 17:31:32.591463 dv-cinder-848013-1-smb devstack@keystone.service[86673]: *** uWSGI is running in multiple interpreter mode *** Jun 28 17:31:32.591463 dv-cinder-848013-1-smb devstack@keystone.service[86673]: spawned uWSGI master process (pid: 86673) Jun 28 17:31:32.591687 dv-cinder-848013-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 28 17:31:32.593254 dv-cinder-848013-1-smb devstack@keystone.service[86673]: spawned uWSGI worker 1 (pid: 86679, cores: 1) Jun 28 17:31:32.593254 dv-cinder-848013-1-smb devstack@keystone.service[86673]: spawned uWSGI worker 2 (pid: 86680, cores: 1) Jun 28 17:31:32.593254 dv-cinder-848013-1-smb devstack@keystone.service[86673]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 17:31:38.113750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:31:38.113750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: from cryptography.utils import int_from_bytes Jun 28 17:31:38.114565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:31:38.114565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: from cryptography.utils import int_from_bytes Jun 28 17:31:38.120708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:31:38.120708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: from cryptography.utils import int_from_bytes Jun 28 17:31:38.121187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 17:31:38.121187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: from cryptography.utils import int_from_bytes Jun 28 17:31:38.162636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:31:38.162818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:31:38.162995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] command line args: [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:31:38.163290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:31:38.163489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ================================================================================ {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:31:38.163730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] admin_token = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.163977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] config_dir = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.164173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.164385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] config_source = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.164500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] debug = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.164713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.165042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.165253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.165508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.165756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.165972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.166173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_config_append = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.166346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.166539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_dir = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.166706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_file = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.166955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.167203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.167390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 17:31:38.167507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.167586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 17:31:38.167702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] command line args: [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 17:31:38.167774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.167843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.167918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 17:31:38.168029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ================================================================================ {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 17:31:38.168223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] admin_token = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] config_dir = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] config_source = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.168989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] debug = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.169974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_config_append = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] publish_errors = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_dir = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.170993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_file = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.171986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] standard_threads = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.172993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] use_journal = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] use_json = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] use_stderr = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] use_syslog = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.173878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.174049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.174158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.174313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.174452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.174654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.174812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.174891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.174970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] publish_errors = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.175123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.175207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.175371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.175455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.175938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.176021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.176182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.176265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.176410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.176488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.176635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] standard_threads = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.176713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.176862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.176941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.177099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.177220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.177300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.177370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.177437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] use_journal = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.177583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.177662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] use_json = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.177792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] use_stderr = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.177912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.178140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] use_syslog = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.178214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.178376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.178669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.178760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 17:31:38.178871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.179838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.180944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.181994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.182941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.183881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.184968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.185970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.186900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.187978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.188978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.189882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.190933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.191927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.192883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.193829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.194974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.195913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.196912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.197841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.external = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.198939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.password = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.199986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] auth.token = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.200893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.201989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.202943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.external = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.203993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.password = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.204977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] auth.token = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.205899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.206870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.207972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.208957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.209888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.210904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.211986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.212934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.213883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.214906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.215824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216245 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.216976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.217931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.218906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.219970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.220996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.221977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.222895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.223989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.224981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225229 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.225958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.226966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.227914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.228987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.229919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.230961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.231890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] role.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] role.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.232994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.233910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.234962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.235841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.236992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] role.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.237927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] role.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.238957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.239929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.240984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.241868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.242853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.243949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.244987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.connection = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.245999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.246959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.247904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.248876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.249679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:31:38.249755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.250008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.250246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.250507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.250744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.250990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.251293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.251555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.connection = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.251804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.252052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.252292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.252537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.252776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.253015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.253254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.253491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.253738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.254005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.254253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.254489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.254744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.254981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.255226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.255464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.255697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.256225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 17:31:38.256987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 17:31:38.282747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.282964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.283195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.292433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.296945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.297178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.297394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.307457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.321766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.321978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.326834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.327068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.469672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.472703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.518107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.518322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.519428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.519667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.582877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.583960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.584233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.584864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.609886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.610770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.622041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.622489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.635481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.635691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.635785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.635905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.636899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.637141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.637274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 28 17:31:38.654513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.654696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 17:31:38.655056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.655178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.655274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 17:31:38.655339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 17:31:38.655519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.655655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.655757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.655848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 28 17:31:38.656056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.656191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.656261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.656334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.656550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.656810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.667182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.667462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.667737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.668027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.668153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.668408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.668671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.668949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.676736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.677644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.680206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.680485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.680744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.681618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.681969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.682985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.683077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.683307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.683573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.683846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.684095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.709645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.710580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.711307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.711590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.712205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.712490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.716876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.717272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.717558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.717728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.718174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.718455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.725010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.725235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.725715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.725984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.729742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.730040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.730349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.730474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.730619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.730752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.730919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.731803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.732093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.732360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.750782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.751025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.753173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.753452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.755705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.758124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.759432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.759839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.761762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.762237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.764882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.767197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.768516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.770826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.772260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.773004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.773004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.773120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.773375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.773662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.774846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.775146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.775438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.775721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.776010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.776294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.792891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.793177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.793449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.793685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.795526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.795817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.796080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.796344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.802070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.803833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.804204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.804753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.806474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.806749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.807348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.807630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.807911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.808195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.808455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.809969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.810246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.810524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.810801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.811086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.821714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.822005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.822313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.822594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.824335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.824558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.824681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.824834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.824956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.825116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.825406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.827157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.827446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.827739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.843081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.845539 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.846357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.848826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.849720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.851496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.852205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.853139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.853421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.853772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.853891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.855567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.855844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.856119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.861052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.862688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.863420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.865176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.866346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.866639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.867034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.867315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.868480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.868780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.869173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.869458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.876446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.876741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.877021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.878559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.878825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.879126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.884950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.885233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.885498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.885799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.886102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.886474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.886745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.886971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 28 17:31:38.887063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.887908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.888960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.889236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.889518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.889786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.890070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.890338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.890610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 28 17:31:38.926922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641e51569c0 pid: 86679 (default app) Jun 28 17:31:38.928793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641e51569c0 pid: 86680 (default app) Jun 28 17:31:38.930536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eafa2-c551-46d3-8b8a-2808105907d8 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:38.930833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eafa2-c551-46d3-8b8a-2808105907d8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:38.931114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eafa2-c551-46d3-8b8a-2808105907d8 None None] PATH_INFO: `/v3` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:38.935302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Jun 28 17:31:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:46.707765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:46.708420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:46.708420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:46.713470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:31:46.719602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:46.720148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:46.720148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:46.794922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: INFO dbcounter [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] Registered counter for database keystone Jun 28 17:31:46.820541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG oslo_db.sqlalchemy.engines [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:31:46.829398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writer thread running {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:31:47.020542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG passlib.handlers.bcrypt [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86679) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 17:31:47.020856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG passlib.handlers.bcrypt [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86679) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 17:31:47.078903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:47.080526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:47.223246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 28 17:31:47.268444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:47.350658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: INFO dbcounter [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] Registered counter for database keystone Jun 28 17:31:47.376489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG oslo_db.sqlalchemy.engines [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 17:31:47.387150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writer thread running {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 17:31:47.540289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730b798-6c3d-478a-a41f-4d942f25dafd None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:47.545179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:47.545932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:47.546304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:47.546627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:47.561443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:47.627427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 17:31:47.627672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044aafd-ac8b-4016-9cc4-02d09093ab1a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:47.638936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Jun 28 17:31:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:31:47.645329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:47.661231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d41a7-43ff-47f6-a802-0a2902c50bd5 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:47.666711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:47.667889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:47.668175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:47.668450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] PATH_INFO: `/v3/projects/bd23346f45c341b78a895818770ee4ca` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:47.672992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd23346f45c341b78a895818770ee4ca)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:47.724719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 28 17:31:47.725647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb512-da31-4dd4-8f4f-5a9e1d41b5a0 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:47.729927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Jun 28 17:31:47 2022] GET /identity/v3/projects/bd23346f45c341b78a895818770ee4ca => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:49.783006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1e17-05b2-4153-8339-96ed0b13c452 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:49.783597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1e17-05b2-4153-8339-96ed0b13c452 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:49.783597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f1e17-05b2-4153-8339-96ed0b13c452 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:49.788782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:49.795279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:49.795836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:49.795836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:49.817176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:49.819517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:49.827612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 28 17:31:49.852498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1e17-05b2-4153-8339-96ed0b13c452 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:49.867402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f1e17-05b2-4153-8339-96ed0b13c452 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:49.872231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:49.872891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:49.873173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:49.873444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:49.882312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:49.884094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f1c2d-3782-43a7-86d2-2cad0e19748e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:49.893525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Jun 28 17:31:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:31:49.900209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:49.910981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde0c78-2250-419d-b2bc-e63beb6749b3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:49.917873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:49.918842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:49.919122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:49.919397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:49.921133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:49.923134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fd882-2ab0-443c-8762-0651fcc28b1a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:49.924966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Jun 28 17:31:49 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:52.093119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c20-2b9e-43ef-9d07-96bf2e1d4ad8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.093630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c20-2b9e-43ef-9d07-96bf2e1d4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.093630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3c20-2b9e-43ef-9d07-96bf2e1d4ad8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.094961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:52.100427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070cba-360a-417a-9ddf-48696915a13d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.100905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070cba-360a-417a-9ddf-48696915a13d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.101053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070cba-360a-417a-9ddf-48696915a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.107813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1cf0f-fc75-41c8-860d-9db4c5886d75 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.108101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1cf0f-fc75-41c8-860d-9db4c5886d75 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.108378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1cf0f-fc75-41c8-860d-9db4c5886d75 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.109734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:52.115079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.115367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.115644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.120249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-87070cba-360a-417a-9ddf-48696915a13d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:52.121472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-87070cba-360a-417a-9ddf-48696915a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:52.156110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG passlib.handlers.bcrypt [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86680) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 28 17:31:52.156556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG passlib.handlers.bcrypt [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86680) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 28 17:31:52.202320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:52.203966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:52.213976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:31:52.237126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87070cba-360a-417a-9ddf-48696915a13d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.263788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:52.316932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:31:52.340222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.354685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87070cba-360a-417a-9ddf-48696915a13d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.389546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:52.390370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.390743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.391019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.454966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90517278-e3b1-4d36-a568-95ea22b47f6c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.457366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:52.467915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:52.469506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:52.500659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:52.501117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:52.502235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.502527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.502848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.516114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:31:52.527974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:31:52.528915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:31:52.529673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 8/14] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:31:52.535367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.584587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 7/15] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:31:52.591347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.652498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1c1f1-6d79-4afc-b0a7-a5c5aef200cc None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.689295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:52.689998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.690281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.690552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.691312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:31:52.691611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:52.693148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:52.706242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:52.712086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.732386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb50258-7512-4521-813a-47f2794f4a08 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.744390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:52.768062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:52.783845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:52.784669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.784953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.785239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.796566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:52.798073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:52.825130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfdbe-129f-4feb-ba21-b72720efdde9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:31:52.834407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:31:52.835297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:31:52.836184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:31:52.836184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:31:52.836184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:31:52.836184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:31:52.836818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:31:52.842998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.863660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:52.864573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:52.864974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:52.865311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:52.867060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:52.868558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:52.870321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:52.876100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:52.963008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec034dd-496c-4a33-985b-9a6c08048e8f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:52.997409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:53.005153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a2d13-552c-4f18-9754-f6fec526223d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:53.006234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:53.007035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:53.007419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:53.007700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:53.008474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:31:53.008780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:53.010314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:53.032212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:53.051482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:53.052403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:53.052690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:53.052969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:53.054434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:53.055989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694b8fa-5a40-469e-af27-6af004177ae5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:53.057801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:53.071737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:53.115999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:53.197202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b89f14-fa30-43f2-aa7d-79545312902a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:53.236255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:53.236873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:53.237159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:53.237443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:53.238363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.domain.id=default, user.id=43de8f9a9dd148ed949cb5d02a060097) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:31:53.238682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:53.240311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143d193-6547-4ae7-ae15-c49265e7ac0d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:53.248497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Jun 28 17:31:53 2022] GET /identity/v3/role_assignments?user.id=43de8f9a9dd148ed949cb5d02a060097&scope.domain.id=default&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:55.374061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6612a-9ff8-4cc7-9b94-e6abb8ce3983 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:55.374580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6612a-9ff8-4cc7-9b94-e6abb8ce3983 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:55.374758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6612a-9ff8-4cc7-9b94-e6abb8ce3983 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:55.375994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:55.381671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f423-7f03-4492-90a2-061d9e3c7167 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:55.382161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f423-7f03-4492-90a2-061d9e3c7167 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:55.382350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3f423-7f03-4492-90a2-061d9e3c7167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:55.404914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-92f3f423-7f03-4492-90a2-061d9e3c7167 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:55.406224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-92f3f423-7f03-4492-90a2-061d9e3c7167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:55.497134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:31:55.535011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6612a-9ff8-4cc7-9b94-e6abb8ce3983 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:55.680613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6612a-9ff8-4cc7-9b94-e6abb8ce3983 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:55.731082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:55.731921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:55.732201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:55.732479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:55.743608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51784f8c-9895-4586-be59-2cbbe72c0350 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:55.743941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51784f8c-9895-4586-be59-2cbbe72c0350 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:55.744277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51784f8c-9895-4586-be59-2cbbe72c0350 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:55.745711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:55.751829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:55.752122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:55.752502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:55.764696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:55.766246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:31:55.804204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:31:55.805069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:31:55.805858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:31:55.805858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:31:55.805858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:31:55.805858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:31:55.806103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:31:55.810882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:55.811584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:55.812648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:55.841932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:55.866315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:55.943118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:31:55.978733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:55.986169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5b071-b9b0-497a-95fc-7fd3ccb1f009 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:56.078358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:56.079049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.079322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.079592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.080330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:31:56.080632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:56.082065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:56.122214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:56.131460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:56.226051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92aba0-1b08-4058-abf5-8c5d4f84d116 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:56.286316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:56.307319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:56.308125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.308497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.308840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.309684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:56.311217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77ca94-2849-41aa-bbb2-ebe0271447e5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:56.320312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28865b-22ab-40c5-b113-e844a037aef2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:56.373783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:56.374535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.382452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.382735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.383676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:56.385350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100941d7-c719-447b-91d9-154d9c41593b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:56.469260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 14/28] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Jun 28 17:31:55 2022] POST /identity/v3/roles => generated 219 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:31:56.474157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc455d-36fa-4563-b75a-b7aa49905ea1 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.474157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc455d-36fa-4563-b75a-b7aa49905ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.474157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc455d-36fa-4563-b75a-b7aa49905ea1 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.477788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 15/29] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:56.479317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c3ce-38e2-49ea-92c6-a14de211f57e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.479609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c3ce-38e2-49ea-92c6-a14de211f57e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.479890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2c3ce-38e2-49ea-92c6-a14de211f57e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.481255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:56.490072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.490072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.490072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.519364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:56.521154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:56.558334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:56.567576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 15/31] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:31:56 2022] POST /identity/v3/projects => generated 301 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:31:56.569616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.569910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.570254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.621495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:56.624478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:56.700350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:31:56.725984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:56.815274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:31:56.851331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:56.928948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61fcd9-a93e-40c0-8fde-4e3d4e47f255 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:56.975881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:56.987799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:56.989700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:56.990186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:56.990869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:56.991851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:56.993918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43851f0-63e1-43b1-97c2-3e7a63dd6972 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.013454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 18/34] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Jun 28 17:31:56 2022] POST /identity/v3/roles => generated 225 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:31:57.014685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ca67-6335-4941-a5f3-7eec31cb4cf7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.015037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ca67-6335-4941-a5f3-7eec31cb4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.015341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1ca67-6335-4941-a5f3-7eec31cb4cf7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.016831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 19/35] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:57.025308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1da23-faa0-4422-b7fe-755c19f4aa93 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.025889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1da23-faa0-4422-b7fe-755c19f4aa93 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.026452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1da23-faa0-4422-b7fe-755c19f4aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.045436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8fe1da23-faa0-4422-b7fe-755c19f4aa93 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:57.047128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8fe1da23-faa0-4422-b7fe-755c19f4aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:57.050287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.067036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dc1e2-9909-428d-867e-36f7e4522870 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.126483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.127351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.127636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.127945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.140915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:31:57.145047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:31:57.146966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c88b-812a-49a7-8cc2-183b36f6204e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.147441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c88b-812a-49a7-8cc2-183b36f6204e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.147850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9c88b-812a-49a7-8cc2-183b36f6204e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.149390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 21/37] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-0e0819f2-5897-42c5-8a56-8d8f4e3b89ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:31:57.149507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:31:57.150333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:31:57.151102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 17/38] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:31:57.156935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.158135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9c88b-812a-49a7-8cc2-183b36f6204e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.159027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.159849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.187382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:31:57.189661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:31:57.273045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 18/39] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:31:57.274026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.318618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9c88b-812a-49a7-8cc2-183b36f6204e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.345300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.356671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.357463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.357899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.358272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.359235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:31:57.359592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.361355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.372389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.377908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 22/40] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:57.379477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.425880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06c09-418c-4c98-9ef3-34127e49ef78 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.471912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.472622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.472903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.473167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.473979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.475805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.494654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 19/41] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Jun 28 17:31:57 2022] POST /identity/v3/roles => generated 223 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:31:57.495957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.536586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847550-cf5a-4af6-9063-73e53a3e00c2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.587545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.588617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.589031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.589491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.591434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.593164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.595712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 23/42] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:31:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:57.602523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.629781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5703b-79af-4573-a583-ece0332b166a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.640057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.675883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.676823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.677179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.677515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.679701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.681255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.683401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 20/43] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:31:57 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:31:57.689525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.826141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.839564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fec8a5-3301-40d5-8d7e-dec47fe1b23c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.874110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.874934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.875215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.875491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.876679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.878179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.879809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:31:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:31:57.882330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8095d-4ba1-4d54-93ae-2614c6c383c1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:57.886017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:31:57.925618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:57.926334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:57.926615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:57.926897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:57.928077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:57.929584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a9fb3-56d8-498e-986d-8576299dd945 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:57.935639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:31:57.961150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:31:57 2022] POST /identity/v3/projects => generated 312 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:31:58.115371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8596a3-d148-4675-94fe-84e2d68f67d8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:31:58.157655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:31:58.158595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:31:58.158876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:31:58.159173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] PATH_INFO: `/v3/domains/default/users/43de8f9a9dd148ed949cb5d02a060097/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:31:58.164557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=43de8f9a9dd148ed949cb5d02a060097, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:31:58.166087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d661d-44cf-43b5-9fc7-dc0bc99d721a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:31:58.189380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 22/46] 10.222.0.48 () {58 vars in 1361 bytes} [Tue Jun 28 17:31:57 2022] PUT /identity/v3/domains/default/users/43de8f9a9dd148ed949cb5d02a060097/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:32:00.066126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34fb0-c813-4ab3-b0aa-68992390d44a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.066703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34fb0-c813-4ab3-b0aa-68992390d44a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.066703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e34fb0-c813-4ab3-b0aa-68992390d44a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.068508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:00.074638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.075135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.075343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.093140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:00.094386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:00.166590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:00.190959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34fb0-c813-4ab3-b0aa-68992390d44a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:00.300742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e34fb0-c813-4ab3-b0aa-68992390d44a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:00.323021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:00.339872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:00.340686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.340996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.341296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.342545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:00.344010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bb94a-324d-44f6-9949-4238694f53a9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:00.345664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:00.352764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:00.387896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:00.479869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c9cd-65c4-4f32-85ff-014085be1268 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:00.532603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:00.533280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.533565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.533841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.534588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:00.536083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c934f6-6c49-4183-a15b-fa1ed4c827d0 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:00.564111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 24/50] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Jun 28 17:32:00 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:00.966568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd298-bea1-4302-bc62-49d7a53914e4 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.967076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd298-bea1-4302-bc62-49d7a53914e4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.967585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cd298-bea1-4302-bc62-49d7a53914e4 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.970233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 27/51] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:00.978105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:00.978513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:00.978797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:00.996906 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:00.998284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:01.089221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 25/52] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:01.113082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd298-bea1-4302-bc62-49d7a53914e4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:01.240808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cd298-bea1-4302-bc62-49d7a53914e4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:01.290499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:01.291873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:01.292371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:01.292856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:01.314206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:01.327334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:01.328281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:01.329006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 28/53] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:01.334881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:01.351317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:01.454386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b279b-40f5-4ffe-b1d4-e586a4cf5eac None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:01.502204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:01.502917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:01.503197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:01.503474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:01.504255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:01.504565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:01.506132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:01.516720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 26/54] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:01.523020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:01.602493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:01.685150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0a488-77a6-4577-be82-ef62648c796d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:01.728675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:01.730305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:01.730779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:01.731248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:01.733581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:01.736377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:01.740316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 29/55] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:01 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:01.748529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:01.858481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:01.884730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa79cdd-9b31-45f6-9685-cf9de2a27a97 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:01.923133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:01.923953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:01.924231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:01.924505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:01.926136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:01.927681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04ae1-d7b7-4b2b-8eed-d8e5684f80d3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:01.929525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 27/56] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:01.935714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:02.087607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de05f7c-44cf-4ef6-88dc-a70b8ca0f63f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:02.120673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:02.153884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:02.155024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:02.155523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:02.156014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:02.157568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.domain.id=default, user.id=43de8f9a9dd148ed949cb5d02a060097) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:02.158162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:02.160945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b08c70-ecbf-47dc-a4fb-73a1d7ed4292 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:02.172774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 30/57] 10.222.0.48 () {56 vars in 1322 bytes} [Tue Jun 28 17:32:01 2022] GET /identity/v3/role_assignments?user.id=43de8f9a9dd148ed949cb5d02a060097&scope.domain.id=default&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 530 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:02.688613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f77-9e9a-4751-9e4b-f53013e138bf None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:02.689155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f77-9e9a-4751-9e4b-f53013e138bf None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:02.689712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101f77-9e9a-4751-9e4b-f53013e138bf None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:02.692440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 28/58] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:02.701204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:02.701620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:02.702088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:02.725547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:02.726872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:02.811942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:02.837253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f77-9e9a-4751-9e4b-f53013e138bf None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:02.962503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101f77-9e9a-4751-9e4b-f53013e138bf None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:03.007421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:03.007421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:03.007421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:03.007421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:03.010247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:03.010893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ddd12-d825-488f-aac7-a811d890924d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:03.012783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 29/60] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:03.019126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:03.159950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d175f-131c-4ecb-ac12-704deae192ab None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:03.172369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:03.213257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:03.214313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:03.214808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:03.215312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:03.216680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:03.219467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3b6c-c140-41c5-8f03-84535a9721f3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:03.263485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:03 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:07.166003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ee1-1a04-4aa8-9f80-f3b06cfa314d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.166003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ee1-1a04-4aa8-9f80-f3b06cfa314d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.166003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f02ee1-1a04-4aa8-9f80-f3b06cfa314d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.167269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 30/62] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:07.173209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d479aa-f356-4ed1-b63d-0089003af038 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.174214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d479aa-f356-4ed1-b63d-0089003af038 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.175058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d479aa-f356-4ed1-b63d-0089003af038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.189866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c9b6-c3a6-4f7d-a74e-aff6f7c45afc None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.190531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c9b6-c3a6-4f7d-a74e-aff6f7c45afc None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.190997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c9b6-c3a6-4f7d-a74e-aff6f7c45afc None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.192648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:07.200728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.201364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.201833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.207169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-45d479aa-f356-4ed1-b63d-0089003af038 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:07.208750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-45d479aa-f356-4ed1-b63d-0089003af038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:07.242980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:07.245555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:07.266291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:07.313524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 33/64] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:07.323468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea10e-bb47-4b4c-9f26-6f88e62d3b9f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.324018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea10e-bb47-4b4c-9f26-6f88e62d3b9f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.324444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aea10e-bb47-4b4c-9f26-6f88e62d3b9f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.326350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 34/65] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:07.335506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.336020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.336465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.347980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:07.351190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:07.377833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:07.381110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:07.476392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 35/67] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:07.478001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:07.519213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:07.564407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4877af-3aa2-45cb-bac3-3c3e7117a19e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:07.607064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:07.607889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.608328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.608854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.621241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:07.630042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:07.631036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:07.631801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:07.634399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 33/68] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:07.635516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:07.638855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:07.661919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8068a-3ac7-499a-acb5-2d3ad14f606a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:07.730963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:07.732186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.732693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.733194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.752138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defc011-2905-43e7-ab88-8ec08685baba None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:07.754766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:07.768058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:07.768961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:07.769714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:07.771276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:07.780539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:07.796859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:07.798138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.798619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.799148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.812009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:07.820287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:07.821258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:07.822313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:07.824672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:07.894663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:07.938438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128195-cb21-4e81-a1a2-f378cce606c2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:07.949774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:07.976570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044c5e6-bbe4-4707-bf18-a6a829708da9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:07.976857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e0346-695e-409a-b41c-a427e292223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:07.977416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0346-695e-409a-b41c-a427e292223f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.977765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0346-695e-409a-b41c-a427e292223f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.978093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e0346-695e-409a-b41c-a427e292223f None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.979007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e0346-695e-409a-b41c-a427e292223f None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:07.979433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e0346-695e-409a-b41c-a427e292223f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:07.980885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e0346-695e-409a-b41c-a427e292223f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:07.990572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:07.991884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2afbc-a9c7-4c93-b1a0-5b708cd616b8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:07.992178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2afbc-a9c7-4c93-b1a0-5b708cd616b8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:07.992460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2afbc-a9c7-4c93-b1a0-5b708cd616b8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:07.998109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 36/72] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:07.998801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2afbc-a9c7-4c93-b1a0-5b708cd616b8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.026195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.026902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.027184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.027464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.028240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:08.028546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.030316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.040574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:08.041457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.126148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2afbc-a9c7-4c93-b1a0-5b708cd616b8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.161630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.180473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.181862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.182332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.182599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.183369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:08.183677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.185108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70274d43-d923-435f-900e-16b44ca44b52 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.195320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:08.196456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.196743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.197013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.210797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a6cd7-bddc-480b-9f64-d05f5902f74d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.219690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:08.221342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:08.258617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.259889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.260351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.260926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.279704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.281300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.288906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:08.288906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.300477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.320409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:08.321530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.439257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b598-0410-40d9-8ba9-1e7cca50ae37 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.464115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1a2b9-bd84-42a7-8dbf-02e01df0a925 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.476401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.477310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.477593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.477869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.479168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.480635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.482364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:08.483144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.495380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.527306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.528794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.529302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.529789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.532170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.535051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.538281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:08.539744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.577995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.615337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b234e7-c62d-426a-be7a-4bbc8520ca29 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.668830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.669891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.670408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.670886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.677342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e05fa0-264a-4a70-88d8-24b7dfd9a221 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.720885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.722232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.722691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.723146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.740034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-beb2dceb-8ba1-4698-bde0-9039f96ad1be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:08.754452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:08.755644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:08.756740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:08.760894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc226-0ed0-4020-950b-8a29cd47d6a7 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.761407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc226-0ed0-4020-950b-8a29cd47d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.761930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fc226-0ed0-4020-950b-8a29cd47d6a7 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:08.764671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 41/80] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:08.766056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc226-0ed0-4020-950b-8a29cd47d6a7 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.786604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:08.789258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:08.842624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.916258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:08.930740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fc226-0ed0-4020-950b-8a29cd47d6a7 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:08.955876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:08.957341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:08.975320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:08.976005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:08.976289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:08.976564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.077775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.079471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.097703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac90a7-3b96-4458-9346-fd3f5ac1d346 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.136236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.142526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.143420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.143789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.144156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.191718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.221467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:09.224652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.226413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.229265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdcc77-a298-49af-8650-b5d9bb24ef82 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.345903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3e396-75f2-4996-b2da-ed807637303d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.346166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 41/83] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:09.347204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.347490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.347763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.367343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:09.368598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:09.402334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.403527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.403991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.404419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.405726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:09.406390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.408990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.423028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:09.423910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.435058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.469978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 42/85] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:09.469978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.469978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.578635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b846f-38a4-4bd4-b8bf-13b65b7a3686 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.586345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32ffa-ca24-4360-a1f4-b42997f8d6f2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.619523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.620567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.621035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.621435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] PATH_INFO: `/v3/projects/3ae9aca02d264e1682d4a15b95071345` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.623041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] RBAC: Authorizing `identity:get_project(project_id=3ae9aca02d264e1682d4a15b95071345)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.624773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.626809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/projects/3ae9aca02d264e1682d4a15b95071345 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:09.628282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.637205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.638440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.638822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.639180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.640580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.642221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.644645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:09.645355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.742521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.771768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:09.793829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6a9ba-6e78-4048-8884-d43225390893 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.813750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1b4cb-ebbe-4eff-9be1-f9c85f17ced3 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:09.845866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.846803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.847086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.847361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.848801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.850545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.852461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:09.859975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:09.872667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:09.873650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:09.874108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:09.874505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:09.876162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:09.878092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:09.880853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:09.881643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:10.005226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2035a-24e7-4623-a716-55ce41b1409f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.034269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5d296-8998-43a5-ae1c-3e05c962cc3a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.055944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.056938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.057330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.057697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.059353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.061071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.063337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:10.064415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:10.082162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:10.090109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.091138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.091596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.092033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.093433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=3ae9aca02d264e1682d4a15b95071345, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:10.093924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.096542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.110231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:09 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=3ae9aca02d264e1682d4a15b95071345&role.id=92f222645a174bcab24981d46e9900f9 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:10.111083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:10.122928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:10.258215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dc18e-98eb-4ee8-802f-266d6efcacf5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.262436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4be3-d6c5-4919-ac5c-9b1dd568c33c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.316321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.316321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.316321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.316321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.316949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:10.316949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.318036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.329564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:10 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=92f222645a174bcab24981d46e9900f9 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:10.331291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:10.341031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.344806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.346008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.348378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.350362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=43de8f9a9dd148ed949cb5d02a060097) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:10.354620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.358115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.374028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:10 2022] GET /identity/v3/role_assignments?user.id=43de8f9a9dd148ed949cb5d02a060097&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:10.375419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:10.503873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:10.542493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:10.586586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0db2d-ea3b-40f6-9766-9302637044f2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.621456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ec66-20f0-4ae7-9dc7-cc739e5a19db None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:10.631405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.633525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.634095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.634567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.635537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.637285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.683688 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 48/94] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:10 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:10.710461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:10.711601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:10.712136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:10.712649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:10.807475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:10.809104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:10.899378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:10.937495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 47/95] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:10.943511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:11.068633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ea655-b387-46ff-a965-ea5221f36b6b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:11.099783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:11.112971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:11.113882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:11.114194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:11.114811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:11.116557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:11.118505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea5f1c-3159-4c3c-987d-e8ab4362a55a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:11.120611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:10 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:11.126864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:11.245368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845779-2d83-4190-be2e-aedb4b96d783 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:11.286021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:11.287225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:11.287225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:11.287698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:11.293995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:11.293995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:11.293995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fee46-a68d-423c-98ff-e31f3d8387db None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:11.297596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:11 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:13.615702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cb11-6c7b-4a7e-9d6b-c5b39ec31cec None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:13.616260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cb11-6c7b-4a7e-9d6b-c5b39ec31cec None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:13.616736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060cb11-6c7b-4a7e-9d6b-c5b39ec31cec None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:13.619321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:13.628360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab856-524d-4982-817c-436f1f846a33 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:13.628932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab856-524d-4982-817c-436f1f846a33 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:13.629337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ab856-524d-4982-817c-436f1f846a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:13.669278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-811ab856-524d-4982-817c-436f1f846a33 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:13.671361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-811ab856-524d-4982-817c-436f1f846a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:13.755505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:13.850931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:13.903707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060cb11-6c7b-4a7e-9d6b-c5b39ec31cec None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:14.147213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060cb11-6c7b-4a7e-9d6b-c5b39ec31cec None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:14.207254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d672-303f-4f04-8f19-27619643a9ca None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.207751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d672-303f-4f04-8f19-27619643a9ca None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.208294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836d672-303f-4f04-8f19-27619643a9ca None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.210969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 50/100] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:14.228002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21556ce-6872-4af7-8690-f4ae7fb064aa None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.228500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21556ce-6872-4af7-8690-f4ae7fb064aa None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.228978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21556ce-6872-4af7-8690-f4ae7fb064aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.266209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b21556ce-6872-4af7-8690-f4ae7fb064aa None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:14.268130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b21556ce-6872-4af7-8690-f4ae7fb064aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:14.279182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:14.280470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.280924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.281355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.310366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:14.333376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:14.334380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:14.335139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:14.339893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:14.346003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:14.431288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 51/102] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:14.455368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756d12-201b-4f98-b310-e5ceae322114 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.455835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756d12-201b-4f98-b310-e5ceae322114 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.456322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21756d12-201b-4f98-b310-e5ceae322114 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.459268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 52/103] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:14.467740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21756d12-201b-4f98-b310-e5ceae322114 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:14.533475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:14.672058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb926a6-aa24-4efb-81e8-9be3bdbc71f1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:14.688663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:14.704190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21756d12-201b-4f98-b310-e5ceae322114 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:14.788214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:14.788926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.789218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.789501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.790328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:14.790643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:14.792088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284aceb7-d199-4ca3-8057-7d4432c55b39 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:14.810067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:14.811414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.811901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.812377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.822254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 52/104] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:14.824157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:14.824644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:14.825135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:14.853689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:14.869410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:14.871155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:14.872600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 53/105] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:14.875455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:14.900771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:14.905989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:15.051153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 53/106] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:15.051721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.121131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157f82-c32f-4b2b-80d2-998e8dc64ba9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.125227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:15.184423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a254640-0d1a-41ea-a676-93842f774193 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.188810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.190446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.190966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.191456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.193772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.196734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5da1-350c-461c-8be4-7ddb0ca87c2b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.200025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 54/107] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:14 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:15.202124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f097b-7a05-4281-ad6c-88acf47384d6 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.202586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f097b-7a05-4281-ad6c-88acf47384d6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.203062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f097b-7a05-4281-ad6c-88acf47384d6 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.205516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 55/108] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:15.207474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f097b-7a05-4281-ad6c-88acf47384d6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.230822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.231902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.232378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.232835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.233714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:15.234365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.236353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4705-b6b8-40e2-ba31-e382353c9c8d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.245072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:15.248178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 54/109] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:15.250375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a517-2d6e-422e-9ea1-ef29610e94bb None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.250629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a517-2d6e-422e-9ea1-ef29610e94bb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.251085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6a517-2d6e-422e-9ea1-ef29610e94bb None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.253495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 55/110] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:15.254702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6a517-2d6e-422e-9ea1-ef29610e94bb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.385775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f097b-7a05-4281-ad6c-88acf47384d6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.428965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6a517-2d6e-422e-9ea1-ef29610e94bb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.443360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.444637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.445090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.445539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.446749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:15.460246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-05af33a5-c6d1-4d8e-bc95-c402521341b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:15.469770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:15.471750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:15.473239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:15.477225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4318341-857e-45a4-b2e8-0c4aac077ea9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.478003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4318341-857e-45a4-b2e8-0c4aac077ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.478471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4318341-857e-45a4-b2e8-0c4aac077ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.482439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.483867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.484316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.484787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] PATH_INFO: `/v3/projects/3ae9aca02d264e1682d4a15b95071345` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.486784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] RBAC: Authorizing `identity:get_project(project_id=3ae9aca02d264e1682d4a15b95071345)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.489127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.493134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 56/112] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/projects/3ae9aca02d264e1682d4a15b95071345 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:15.494495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.506500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a4318341-857e-45a4-b2e8-0c4aac077ea9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:15.508407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a4318341-857e-45a4-b2e8-0c4aac077ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:15.597571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 57/113] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:15.599495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.599982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.600297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.620208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:15.621589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:15.634383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:15.647603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b2cb5-ec5a-4c35-8234-4b7b814aef4d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.688954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.690419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.690867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.691316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.693413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.695839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9252395-0895-4706-bb89-2acd4d6947e5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc531-9d48-4c9f-91ef-08730217a4d3 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc531-9d48-4c9f-91ef-08730217a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bc531-9d48-4c9f-91ef-08730217a4d3 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 58/115] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:15.704867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc531-9d48-4c9f-91ef-08730217a4d3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.713934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:15.715345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.772650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:15.843097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bc531-9d48-4c9f-91ef-08730217a4d3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.854842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80587d86-020f-490b-ad22-67f5f3327fad None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:15.883342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.884033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.884340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.884595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.885360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:15.885668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.887141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.896936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 59/117] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:15.898637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.900049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:15.901674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:15.902242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:15.902740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] PATH_INFO: `/v3/projects/3ae9aca02d264e1682d4a15b95071345/users/da0681f3e0df4db8a4c6beee6310e04c/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:15.905622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ae9aca02d264e1682d4a15b95071345, user_id=da0681f3e0df4db8a4c6beee6310e04c, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:15.907332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:15.934324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 59/118] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:15 2022] PUT /identity/v3/projects/3ae9aca02d264e1682d4a15b95071345/users/da0681f3e0df4db8a4c6beee6310e04c/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:15.940155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:15.945661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.048681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e231-9a05-4538-b08e-5055beb91d5b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.064040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.115713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.116672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.117031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.117369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.137662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:16.145559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dba352-26de-41d9-a2d4-f503c4c95c36 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-71626ecc-db2a-4e23-80d2-b848cf030262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:16.152494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:16.153396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 60/119] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:16.159809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.160728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.160728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.187340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:16.189321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:16.212636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.213860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.214211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.214479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.215803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.217329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.219181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:15 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:16.222289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.288226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:16.289187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.327509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.385894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbc99-2924-420a-b0a7-27ceeabd260c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.417588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.423974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad515f1b-a063-4678-a16d-93fce9a8834a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.426231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.428132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.428418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.428707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.445205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:16.454598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:16.455774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:16.456698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.472435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.474091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.474630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.475159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.477451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.479872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.482885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:16.484261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.619703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f76f61-8ed4-4838-aee1-e1e1f1b8eb70 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.620134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1c276-6fb5-4e85-86ad-b0fae32e9a55 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.659072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.659967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.660246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.660528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/da0681f3e0df4db8a4c6beee6310e04c/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.663257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, user_id=da0681f3e0df4db8a4c6beee6310e04c, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.664663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.664812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.672297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.673036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.673523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.673857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.675219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:16.675523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.677156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.686911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 62/124] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:16.687409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 63/125] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:16 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/da0681f3e0df4db8a4c6beee6310e04c/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:16.688937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.692182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.734217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:16.835839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf1c08-7f87-4422-892e-294649a512f4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.851672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a17739-ca5a-47bd-a8c6-28ecdc3e7f18 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:16.884301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.885015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.885303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.885575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.886382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:16.886779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.888890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.901871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:16.902934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.915731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:16.916991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:16.917478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:16.917969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:16.919466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:16.921175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:16.923209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:16.924294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:16.992064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.006602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.019007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57d45c-2c42-4e05-bb4d-a85e50be0277 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.042172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92cd16-00fe-47ff-9c5f-8ee3f1b8e1ee None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.059532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.060438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.060715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.060993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.062309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.064000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.066126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 65/128] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:17.066845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.094639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.095885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.096388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.096978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] PATH_INFO: `/v3/users/925f152ba41041619d47df41a9350d80` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.112595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] RBAC: Authorizing `identity:get_user(user_id=925f152ba41041619d47df41a9350d80)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.114636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.116841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 64/129] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:16 2022] GET /identity/v3/users/925f152ba41041619d47df41a9350d80 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:17.118044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.189406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730cfd7-f223-4064-9e3c-b9bda4f098f5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.232460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.233771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.234114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.234401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.236291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.237346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004a761-357c-409e-aac0-a93a58178b84 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.238944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.240784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 66/130] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:17 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:17.241576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.265485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.284442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.285510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.286129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.286636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.287590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.289291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.307016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.319627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 65/131] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:32:17 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:17.321123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.446447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1527891-7e29-4647-87fb-48dea8055c24 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.455455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5be40-f1b3-4923-bace-bd5b6cb6226d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.487850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.489146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.490001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.490597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.538807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.540149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.540645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.541125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/43de8f9a9dd148ed949cb5d02a060097/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.545135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, user_id=43de8f9a9dd148ed949cb5d02a060097, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.545411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.547937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.573152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:17 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/43de8f9a9dd148ed949cb5d02a060097/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:17.574521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.599157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.602858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.690553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.720206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f7b8b-9abf-451a-b119-ddea13282619 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.744205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:17.750570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.775420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.777630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.778389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.779159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.781652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.784771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.788832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 68/134] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:17 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:17.795631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:17.842724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:17.881721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4d331-9d8b-4b21-ab25-36ad82c0a03c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:17.925964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:17.927614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:17.928175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:17.929119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:17.931070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:17.933145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:17.942447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 67/135] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:17 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:17.945141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:18.025265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ae1f8-6cb2-4ce1-9b5d-f809462d3005 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:18.089776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:18.090862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:18.091260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:18.091557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/da0681f3e0df4db8a4c6beee6310e04c/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:18.095161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, user_id=da0681f3e0df4db8a4c6beee6310e04c, role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:18.097900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a10d9-c711-4ad4-b15f-f0a4d46a9d89 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:18.130240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:17 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/da0681f3e0df4db8a4c6beee6310e04c/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:18.196310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec3495-e1cd-4276-8761-d4fdc9e3d51f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:18.292980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:18.293683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:18.294003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:18.294404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:18.295702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=925f152ba41041619d47df41a9350d80) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:18.296150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:18.297897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a8d87-aae2-4d87-8ef5-33e04c79b9be None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:18.311077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 68/137] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:17 2022] GET /identity/v3/role_assignments?user.id=925f152ba41041619d47df41a9350d80&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=de3b02a88b974173aff5a985001d7665 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:18.551304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6a02-7c6c-41f2-9a03-5e5b9a67baea None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:18.551708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6a02-7c6c-41f2-9a03-5e5b9a67baea None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:18.551883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6a02-7c6c-41f2-9a03-5e5b9a67baea None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:18.553679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:18.560334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:18.560627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:18.560905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:18.569395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:18.583527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:18.585073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:18.696232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:18.740397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6a02-7c6c-41f2-9a03-5e5b9a67baea None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:18.761649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:18.894954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6a02-7c6c-41f2-9a03-5e5b9a67baea None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:18.941373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:18.942358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:18.942645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:18.942924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:18.960833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:18.968912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:18.969783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:18.970580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:18.974761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:18.980847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:19.132989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb518-c7e2-4276-83d0-dfb5547a5ecc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:19.190831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:19.191930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:19.192470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:19.192968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:19.194013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:19.194530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:19.196170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:19.198167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:19.207453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 70/141] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:19.215502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:19.311668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:19.357118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fb310-a606-4c93-a3f9-cdc37c8dc717 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:19.409483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:19.410432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:19.410711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:19.411044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:19.412996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:19.414709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:19.418136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:19 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:19.423210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:19.583235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad6332-9a4b-40b8-896e-ecbef5a9dbe7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:19.630775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:19.631860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:19.632360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:19.632834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:19.716898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:19.726005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:19.727523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5c5f-14f1-4e8f-8b34-46933643aa67 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:19.894732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:19.901587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:20.074293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6d88-3117-4d52-a969-8368e83ef244 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.074808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6d88-3117-4d52-a969-8368e83ef244 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.074877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6d88-3117-4d52-a969-8368e83ef244 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.076291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 72/144] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:20.086767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.087049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.087347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.094254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f9273-cb85-4390-b6ca-7f3d1ce9bec4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:20.123041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:20.124299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:20.187868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:20.188776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.189059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.189332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] PATH_INFO: `/v3/projects/3ae9aca02d264e1682d4a15b95071345` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.194860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] RBAC: Authorizing `identity:get_project(project_id=3ae9aca02d264e1682d4a15b95071345)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:20.196355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:20.198222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 73/145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:19 2022] GET /identity/v3/projects/3ae9aca02d264e1682d4a15b95071345 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:20.205532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:20.225549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:20.334137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 73/146] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:20.406501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:20.482032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ec31f-3585-4013-9c0c-a3d901ceb94a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:20.508907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:20.602879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:20.603595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.603882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.604164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.605062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=3ae9aca02d264e1682d4a15b95071345, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:20.605380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:20.606951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315fdb7-8a04-436a-b9d9-1138732de2f9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:20.620624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:20 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=3ae9aca02d264e1682d4a15b95071345&role.id=92f222645a174bcab24981d46e9900f9 => generated 608 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:20.722894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745b1e-ee3b-4d2f-ad15-ad974af3f063 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.723219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745b1e-ee3b-4d2f-ad15-ad974af3f063 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.723536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745b1e-ee3b-4d2f-ad15-ad974af3f063 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.726162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 75/148] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:20.735504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ba1dc-452a-4700-a488-b6b40abc2d9b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.739514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3940-a652-457e-96d9-c1700f2fddb7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:20.740533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ba1dc-452a-4700-a488-b6b40abc2d9b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.741262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ba1dc-452a-4700-a488-b6b40abc2d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.800617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ae9ba1dc-452a-4700-a488-b6b40abc2d9b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:20.802967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ae9ba1dc-452a-4700-a488-b6b40abc2d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:20.864130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:20.865577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:20.866126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:20.867355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:20.883899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:20.892485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:20.893393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:20.894259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:20.912593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.014506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.020324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:21.023916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256843d-f7b4-4142-8b79-c6ff1e5b96b8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.024220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256843d-f7b4-4142-8b79-c6ff1e5b96b8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.024496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256843d-f7b4-4142-8b79-c6ff1e5b96b8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.025881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 77/151] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:21.035592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.035992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.036230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.067035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:21.068428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:21.098896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.105145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade13ba-3539-4d9b-b417-ac24397ef660 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.158118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.158805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.159085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.159246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 78/152] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:21.159432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.160038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.160242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:21.160558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:21.162454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:21.183876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 75/153] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:21.192153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.302228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f049546-8e13-474a-a0a2-1662f6554ffa None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.326098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5faba-8efd-4d0f-89be-691330694b29 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.343048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.352672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.353845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.354346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.354793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.356988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:21.359304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:21.362332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 79/154] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:21.363939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.376731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.377634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.377911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.378217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.379626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:21.381040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:21.382805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 76/155] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:21 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:21.383755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.404530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.528099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba96e1-34ac-4a76-acbb-2b5cd9ee3a11 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.531997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aaebf-5b3a-4e71-83ec-4e8171ad3947 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.573407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.574423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.575005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.575484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.576737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:21.579309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:21.600234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.602275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.602820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.603520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.606598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 77/156] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:21 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:21.607739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.644433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:21.671700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:21.672870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:21.673636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:21.678745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 80/157] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:21.682512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:21.705053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.747785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5b6f8-548b-4a61-afa1-bde6bf25a7d2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:21.791736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:21.792828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:21.793313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:21.793791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:21.870710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:21.951341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:21.953876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251ddc0-7d41-417a-aa1e-754e78353512 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:21.955932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861744ef-798b-480d-ac98-b2615c35747e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:22.045842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:22.047709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.048168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.048617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.050380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:22.050874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:22.054025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc12d9d-6469-4f86-a40b-6c229e2505a6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:22.072520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 81/158] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:22.080098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006523-75eb-416c-95b0-ee8074639f6a None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.080543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006523-75eb-416c-95b0-ee8074639f6a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.081003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0006523-75eb-416c-95b0-ee8074639f6a None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.083960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 82/159] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:22.084921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006523-75eb-416c-95b0-ee8074639f6a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:22.107677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:22.172177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 78/160] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:22.174883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.175322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.175763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.211888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:22.220493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:22.317598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0006523-75eb-416c-95b0-ee8074639f6a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:22.346474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:22.368027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:22.369615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.370127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.370606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] PATH_INFO: `/v3/users/43de8f9a9dd148ed949cb5d02a060097` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.372923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] RBAC: Authorizing `identity:get_user(user_id=43de8f9a9dd148ed949cb5d02a060097)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:22.375721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64c36-e525-4fcc-8bdb-e89ea10b8f19 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:22.378418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 79/161] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:22.379786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 83/162] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:22 2022] GET /identity/v3/users/43de8f9a9dd148ed949cb5d02a060097 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:22.380003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:22.385879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd846-c28e-4be2-9e2d-397b30f0b4b9 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.386558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd846-c28e-4be2-9e2d-397b30f0b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.387039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd846-c28e-4be2-9e2d-397b30f0b4b9 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.389858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 84/163] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:22.391210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bd846-c28e-4be2-9e2d-397b30f0b4b9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:22.544084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bd846-c28e-4be2-9e2d-397b30f0b4b9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:22.614952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:22.615422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1ba37-f58d-45f1-9729-015c47415757 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:22.615963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.616426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.616890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.620122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:22.692662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:22.694216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.694559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.695028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.697580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:22.700775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978679-869b-44e5-a46f-3339d3ab53c9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:22.704812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 80/164] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:22 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:22.715809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:22.716298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:22.716790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:22.749299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:22.751529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:22.842655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:22.894984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 81/165] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:22.903234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:22.906314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:22.907828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:23.104276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 85/166] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:23.105169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:23.154593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:23.157480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a860e-5366-486b-aee1-c881cbb9d8b2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:23.221562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:23.222447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:23.222790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:23.223074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:23.244389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:23.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:23.266715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 82/167] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:23.268427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:23.296383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:23.321164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0139-881c-415c-98dd-285d37ae4ae5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:23.401807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:23.402888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:23.403361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:23.403847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:23.406635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:23.406966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:23.408585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:23.433091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 86/168] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:23 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=92f222645a174bcab24981d46e9900f9 => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:23.434245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:23.545166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2a58-c9e7-4280-88d1-cccb8dc3e9c6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:23.649378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:23.650985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:23.651477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:23.652050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:23.678959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7da28-1b18-4acc-95df-cb3be2dfc336 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:23.685216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:23.714797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:23.718134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:23.721300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 83/169] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:23.730176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:23.744793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:23.746250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:23.746712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:23.747186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:23.749393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:23.752082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:23.755589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 87/170] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:23 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:23.770215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:23.799077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:23.853774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:24.027037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb298-9df3-4b5c-a63f-7808a6a54b3a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:24.089188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434b307-a728-4d0c-b93e-67a3e5ed4f14 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:24.097821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:24.099717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:24.100188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:24.100672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:24.110812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:24.111751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:24.113852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:24.138765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:24.145324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:24.217919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:24.219051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:24.219532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:24.220010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:24.221350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:24.221860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:24.224469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:24.261199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:24.263454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:24.377786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:24.416297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f9a5c-d1ba-4375-910b-4c0f0ea29546 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:24.443503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:24.480304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0a7ba-801c-47ce-8b22-d9b2cc2c274b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:24.496672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:24.497754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:24.498232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:24.498667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:24.500286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=43de8f9a9dd148ed949cb5d02a060097) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:24.500786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:24.503393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:24.525826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:24 2022] GET /identity/v3/role_assignments?user.id=43de8f9a9dd148ed949cb5d02a060097&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:24.527476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:24.607734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:24.609287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:24.609828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:24.610341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] PATH_INFO: `/v3/users/da0681f3e0df4db8a4c6beee6310e04c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:24.613487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] RBAC: Authorizing `identity:get_user(user_id=da0681f3e0df4db8a4c6beee6310e04c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:24.618315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:24.621530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 85/174] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:24 2022] GET /identity/v3/users/da0681f3e0df4db8a4c6beee6310e04c => generated 275 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:24.632194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:24.933462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6f637-782b-4e4f-8877-0c14d7d2a2d9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:24.934889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd2382-1c45-42e3-a041-018a1d6362d8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:25.000870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.002124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.002629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.003126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.054391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.055794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.056254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.056720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] PATH_INFO: `/v3/users/925f152ba41041619d47df41a9350d80` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.061348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] RBAC: Authorizing `identity:get_user(user_id=925f152ba41041619d47df41a9350d80)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.064220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.067474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 90/175] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:24 2022] GET /identity/v3/users/925f152ba41041619d47df41a9350d80 => generated 289 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:25.069668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.078472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:25.145988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.219041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.221540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.334217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e80ced-d492-47d2-96f1-82210048477b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:25.391604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 86/176] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 761 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:25.400345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:25.416728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.417656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.417968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.418244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.421748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.423468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.428971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 91/177] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:25 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:25.434993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:25.470164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.529421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa688-29cd-4836-ba94-c08fcf24a5d8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:25.550073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.573614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4405e-1b7b-4388-b476-44b60c70c419 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:25.574357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.575594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.576103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.576593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.578312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.580077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9603-2d49-4058-8d22-a8d3ee79c98e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.582725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 87/178] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:25 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:25.584612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e02c-8b6e-432f-a27a-f81e13bf7971 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.585120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e02c-8b6e-432f-a27a-f81e13bf7971 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.585695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e02c-8b6e-432f-a27a-f81e13bf7971 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.587770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 88/179] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:25.591737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e02c-8b6e-432f-a27a-f81e13bf7971 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:25.614431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.615658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.615889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.616164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/925f152ba41041619d47df41a9350d80/roles/de3b02a88b974173aff5a985001d7665` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.618601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, user_id=925f152ba41041619d47df41a9350d80, role_id=de3b02a88b974173aff5a985001d7665)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.621507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b3ee2-d0ea-48a4-8f63-4022f4d9a378 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.639726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:25 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/users/925f152ba41041619d47df41a9350d80/roles/de3b02a88b974173aff5a985001d7665 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:25.641586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.641880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.642216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.687470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:25.688794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:25.795705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e02c-8b6e-432f-a27a-f81e13bf7971 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:25.834689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.851949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 93/181] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:25.868859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:25.869974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.870439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.870888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.872387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=da0681f3e0df4db8a4c6beee6310e04c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:25.872906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:25.875380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7453f2-d5b9-466e-898a-7467ff50fc19 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:25.879355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:25.886269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 89/182] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:25 2022] GET /identity/v3/role_assignments?user.id=da0681f3e0df4db8a4c6beee6310e04c&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:25.966901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:25.968261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081f70-6e0c-428d-a662-dfe59211e375 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.968960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081f70-6e0c-428d-a662-dfe59211e375 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.969667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081f70-6e0c-428d-a662-dfe59211e375 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:25.980833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 90/183] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:25 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:25.996171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a240dc-b8e5-4f8a-ba2b-31fbdf62665b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:25.996833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a240dc-b8e5-4f8a-ba2b-31fbdf62665b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:25.997355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a240dc-b8e5-4f8a-ba2b-31fbdf62665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.006349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1753c-8950-4f23-b487-6bce538c4753 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.062965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c4a240dc-b8e5-4f8a-ba2b-31fbdf62665b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:26.070062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c4a240dc-b8e5-4f8a-ba2b-31fbdf62665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:26.120392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.121251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.121531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.121803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.140831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-18e28b19-08cd-469b-a7de-46af4fe8db4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:26.149321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:26.151763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 94/184] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:26.153303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cdfe4-3d15-4001-8015-9ae43a614626 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.154747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cdfe4-3d15-4001-8015-9ae43a614626 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.154747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cdfe4-3d15-4001-8015-9ae43a614626 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.154747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 95/185] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:26.158067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cdfe4-3d15-4001-8015-9ae43a614626 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.215363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 91/186] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:26.216745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.217034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.217344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.238181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:26.239547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:26.330309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cdfe4-3d15-4001-8015-9ae43a614626 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.342076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 92/187] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:26.342798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.376057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:26.385347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.386079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.386362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.386641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.387412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:26.387780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:26.389218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:26.393837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:26.402308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 96/188] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:26.408426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.464371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbd77-f302-4444-8678-a777fe6c4245 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.507106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.508113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.508512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.508905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.524401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:26.533263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:26.534382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:26.535451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:26.540760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.546194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c0041-1495-4edb-a201-4f3089d2aa01 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.593166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.594491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.595599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.596078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.598261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:26.601546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:26.609564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:26.609564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.702776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c3546-ff53-4399-a451-e8c2d3f5405e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.703746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:26.704677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:26.745597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.746548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.746822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.747104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.763745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:26.765293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:26.767365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 94/191] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:26.768122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.783874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257f955-a041-4246-9b14-3629f07f1ba7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.849874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.850765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.851181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.851614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.852859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:26.853313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:26.855462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:26.870715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 98/192] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:26.872174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:26.934234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5936c-aaf4-4566-9109-4e336fb5b52f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:26.976908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:26.977856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:26.978002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:26.978225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:26.978949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:26.980501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.007409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 95/193] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:26 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:27.008223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:27.046764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.055774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec1c93-08f4-429d-b576-f533d2717fda None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:27.094537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.109176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:27.110162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:27.110612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:27.111118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:27.198786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:27.201214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.226280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee347a15-82bc-4028-be50-61c7b1610d50 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:27.296132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:27.297127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:27.297470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:27.297760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:27.300705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:27.302532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.304220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:27 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:27.316673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:27.337604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 99/195] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:27.345613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:27.380424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.436338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.469060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc101c0-5bcd-4fe6-9c7a-0637e100e50c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:27.501700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9684320-717e-4d4d-802c-305225ccdde1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:27.529297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:27.530226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:27.530568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:27.530934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:27.553491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:27.554840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:27.555450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:27.555896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:27.557572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:27.559335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.561725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 100/196] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:27 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:27.572871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:27.637758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:27.639856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.836122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.839769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:27.849847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf80607-1d0a-45cc-adf0-2d5ae9952aee None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:27.874843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 97/197] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:27.895644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:27.930765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:27.931893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:27.932367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:27.932856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:27.934524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=0a3acc20b76540cba877fa303c664a36) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:27.935059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:27.937856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:27.949370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 101/198] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:27 2022] GET /identity/v3/role_assignments?user.id=0a3acc20b76540cba877fa303c664a36&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:28.157310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1093a-95f5-4695-8bdc-e769731f4efb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:28.234734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:28.236652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:28.241971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:28.241971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:28.241971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:28.242841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039d472-5fa9-46f6-990a-68387e327e3b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:28.246294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:27 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:28.256351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:28.419952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d67-7da8-4d2d-ab4d-51ddc766af55 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:28.420488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d67-7da8-4d2d-ab4d-51ddc766af55 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:28.420914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5d67-7da8-4d2d-ab4d-51ddc766af55 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:28.423631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 99/200] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:28.443616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:28.444404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:28.445061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:28.499875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:28.502101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:28.509698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a25836-09d9-4978-8200-d2f6e4d10102 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:28.580719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:28.581874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:28.582412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:28.582945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:28.585079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=0a3acc20b76540cba877fa303c664a36) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:28.585637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:28.588801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:28.606048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 102/201] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:28 2022] GET /identity/v3/role_assignments?user.id=0a3acc20b76540cba877fa303c664a36&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:28.644328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:28.679287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 100/202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:28.768448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:28.832073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:29.015885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5badb8-a95f-4f39-a676-93a028d80ba7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:29.088873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:29.090893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:29.091584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:29.092295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:29.121569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:29.141991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:29.143603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:29.145084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:29.154673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 103/203] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:29.161181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:29.378234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3b06-0c2a-4d0f-8f88-0633b5ad0f81 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:29.432386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:29.433368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:29.433368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:29.433851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:29.434442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:29.434758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:29.436177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:29.451273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 101/204] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:29.461088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:29.604707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:29.630349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc9608-b630-48cc-a075-fa30f505d320 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:29.687488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:29.688414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:29.688695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:29.688972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] PATH_INFO: `/v3/users/925f152ba41041619d47df41a9350d80` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:29.690329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=925f152ba41041619d47df41a9350d80)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:29.691851 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:29.694218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 104/205] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:29 2022] GET /identity/v3/users/925f152ba41041619d47df41a9350d80 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:29.702745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:29.842486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:29.963319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b3432-52d4-42cf-b6e3-7ad8573c86aa None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:30.038038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:30.039193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.039693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.040187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.188672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:30.192723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:30.279129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:30.360954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 102/206] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:30.366894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:30.539394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43f885-cded-40cd-a5c8-0422eb4a1bf1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:30.602912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:30.604500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.605019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.605517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.607831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:30.610517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672f8e1-2154-4c83-a1ca-0be475257956 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:30.614306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 105/207] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:30 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:30.621797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:30.622361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9dc5-ce83-4238-9978-9fbfb3456c6a None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.622361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9dc5-ce83-4238-9978-9fbfb3456c6a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.622361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9dc5-ce83-4238-9978-9fbfb3456c6a None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.623177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 106/208] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:30.630130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ad3c-3709-4e38-b8b3-7d22dee77896 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.630434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ad3c-3709-4e38-b8b3-7d22dee77896 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.630893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31ad3c-3709-4e38-b8b3-7d22dee77896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.664101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-be31ad3c-3709-4e38-b8b3-7d22dee77896 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:30.666513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-be31ad3c-3709-4e38-b8b3-7d22dee77896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:30.697368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:30.827498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 107/209] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:30.830367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ef58a-2899-4fa1-b0b2-2717d1f28948 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:30.830568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b3f6-c3fd-45b8-9dd5-e1f316169fe0 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.830896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b3f6-c3fd-45b8-9dd5-e1f316169fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.831381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b3f6-c3fd-45b8-9dd5-e1f316169fe0 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.834123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 108/210] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:30.845494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.850665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.851433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.883757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:30.886499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:30.890352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:30.891165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:30.891666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:30.892137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:30.893236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, scope.project.id=0f00826bf8af4727b1fa61605778bb4c, user.id=925f152ba41041619d47df41a9350d80) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:30.893625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:30.895374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:30.902582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 103/211] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:30 2022] GET /identity/v3/role_assignments?user.id=925f152ba41041619d47df41a9350d80&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=de3b02a88b974173aff5a985001d7665 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:30.903524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:30.916236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:31.011488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 109/212] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:31.099688 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.112479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdef16-fc7d-4293-8034-c2e6d329bd05 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:31.154842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:31.155711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.155998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.156279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.157753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:31.159450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2297e-9e40-4ac9-afe0-994df4270c1b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:31.161705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 104/213] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:31.168130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f013-19bc-4f41-bd6b-c8278ad3ae73 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.168318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f013-19bc-4f41-bd6b-c8278ad3ae73 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.168608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342f013-19bc-4f41-bd6b-c8278ad3ae73 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.170303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 105/214] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:31.175312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f013-19bc-4f41-bd6b-c8278ad3ae73 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.225394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:31.258711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608db65-5215-4c36-b262-835012b7e7b1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:31.308204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:31.309381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.309757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:31.309929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.310243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.327481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:31.335335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342f013-19bc-4f41-bd6b-c8278ad3ae73 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-cf26d820-fc31-4607-8f62-199cd3a3a5f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:31.336047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:31.338359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 110/215] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:31.339916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.345134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.345134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.365758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:31.366977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:31.377220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:31.378156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.378447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.378729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.379853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:31.381270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:31.408308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 106/216] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:31 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:31.415159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.477983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 111/217] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:31.503839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.586869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:31.621126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fe617-6059-4cd7-bf54-b5ec20825264 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:31.657194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a6e94-480d-49a2-b683-efefdf5549e9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:31.671896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:31.684047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:31.685144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.685630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.687268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.688381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:31.688930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:31.690950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:31.705320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 107/218] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:31.712751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.738912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:31.740147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:31.740569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:31.741015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:31.768217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:31.783212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:31.784811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:31.786615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:31.788687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 112/219] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:31.797528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:31.938211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad007-7733-4a43-a669-cc53f053a3ac None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.001194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:32.002792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.003292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.003781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] PATH_INFO: `/v3/users/9b635a7b260641029457c35b621cc8a1` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.011042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0779be-4b88-431f-ac12-4d05d51ae2c5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.031020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] RBAC: Authorizing `identity:get_user(user_id=9b635a7b260641029457c35b621cc8a1)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:32.034039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:32.037494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 108/220] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:31 2022] GET /identity/v3/users/9b635a7b260641029457c35b621cc8a1 => generated 297 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:32.046600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:32.064356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:32.089522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:32.090784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.091238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.091870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.093151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:32.093704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:32.096395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:32.120811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 113/221] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:32.127413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:32.142404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:32.229434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de4d3b-451a-4853-9127-ec309179effe None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.318564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:32.319259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.319550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.319831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.354265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e16b8-0a37-409a-9bce-bd5589628f3c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.426032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:32.429887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.430354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.430773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.433214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:32.435760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:32.438703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 114/222] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:32 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:32.447026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:32.533737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:32.536317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e5f05-7542-4c63-8af0-d33f87c6819f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:32.612355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:32.661102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:32.694849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599550cb-4968-4310-99ad-d19ee898e4f5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.741350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:32.742378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.742723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.743107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.744549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:32.745404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 109/223] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:32.746609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:32.746964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e107b1-7d45-406d-b6cd-68a6edd73184 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.747252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e107b1-7d45-406d-b6cd-68a6edd73184 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.747529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e107b1-7d45-406d-b6cd-68a6edd73184 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.749006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 115/225] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:32 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:32.749126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 110/225] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:32.754230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:32.755345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:32.755669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:32.756006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:32.785346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:32.787621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:32.872289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 111/226] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:32.879481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:32.939734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd020-8d66-440d-aefb-17ebda07d22d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:32.982199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:33.001978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.003460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.003884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.004306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.006673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.009303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.013018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 116/227] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:32 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:33.014631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:33.063027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:33.087686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2789a6-cc33-48a0-a6f3-49654a752d40 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.128350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.130472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.131067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.132010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/0a3acc20b76540cba877fa303c664a36/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.134877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, user_id=0a3acc20b76540cba877fa303c664a36, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.137397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.159872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 112/228] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:32 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/0a3acc20b76540cba877fa303c664a36/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:33.161618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:33.270455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048cafa-342a-4f5b-a805-b56abe6de70e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.303238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ad82-e15b-498a-a134-f861376efd0f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.352297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.353478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.354004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.354486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.355640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=9b635a7b260641029457c35b621cc8a1) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:33.356175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.358831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.366358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 113/229] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:33 2022] GET /identity/v3/role_assignments?user.id=9b635a7b260641029457c35b621cc8a1&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=92f222645a174bcab24981d46e9900f9 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:33.393617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.394921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.395556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.396066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.417147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:33.430106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:33.431039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:33.431798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:33.434853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 117/230] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:33.441539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:33.466573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:33.599688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd88c-bc17-4a46-bdad-5abce86e9d63 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.640017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.640622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.640908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.641188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.641992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:33.642306 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.643743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.653806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 114/231] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:33.659813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:33.724734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:33.782918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b6a5a-4706-4b64-9385-96617f9d4c30 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.819546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.820471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.820753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.821026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.822395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.823889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.825860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 118/232] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:33 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:33.831717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:33.908760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:33.948524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712426f8-7d14-441c-aa5d-8660ec0a93a8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:33.987703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:33.988604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:33.988942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:33.989200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:33.990636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:33.992122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e1375-f52f-48c8-b129-5c43318b536c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:33.998194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 115/233] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:33 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:34.000303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:34.094054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3621e-cc38-4c7f-9d12-c9af075e4264 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.094471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3621e-cc38-4c7f-9d12-c9af075e4264 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.094611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3621e-cc38-4c7f-9d12-c9af075e4264 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.096234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 116/234] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:34.102550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3822cb-9c94-42a6-a1da-b8900d568b27 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.102930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3822cb-9c94-42a6-a1da-b8900d568b27 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.103162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3822cb-9c94-42a6-a1da-b8900d568b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.123652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-da3822cb-9c94-42a6-a1da-b8900d568b27 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:34.124939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-da3822cb-9c94-42a6-a1da-b8900d568b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:34.159310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e5fc3-71de-484b-8422-1beb263b4422 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:34.226349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:34.285843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:34.288144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.289169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.291631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/0a3acc20b76540cba877fa303c664a36/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.300207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, user_id=0a3acc20b76540cba877fa303c664a36, role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:34.303859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:34.344439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 119/235] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:33 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/0a3acc20b76540cba877fa303c664a36/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:32:34.345806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 117/236] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:34.393362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:34.579792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a41c-1973-484c-82c0-e3235659ade7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.579982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a41c-1973-484c-82c0-e3235659ade7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.580247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a41c-1973-484c-82c0-e3235659ade7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.586141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 118/237] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:34.588048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e48e-108d-440d-a799-af335a77a785 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.588335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e48e-108d-440d-a799-af335a77a785 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.588616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e48e-108d-440d-a799-af335a77a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.589282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e12093-a80a-45ca-bae2-b156773c8a9d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:34.607305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-be92e48e-108d-440d-a799-af335a77a785 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:34.608563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-be92e48e-108d-440d-a799-af335a77a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:34.651440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:34.652782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.652782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.652952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.667705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:34.682867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:34.683807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:34.684561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 120/238] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:34.692031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:34.704199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:34.716386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 119/239] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:34.766694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e48e-108d-440d-a799-af335a77a785 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:34.773794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:34.848802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef1e0d-6bf6-4c7f-b6ef-547a92e5074f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:34.933773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e48e-108d-440d-a799-af335a77a785 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:34.967662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:34.968626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:34.969049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:34.969463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:34.970450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:34.972385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:34.974492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:34.990520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 121/240] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:34.996578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:35.024442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.025284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.025567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.025845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.027168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.028719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.030847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 120/241] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:35.041054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:35.112382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d56b6-5506-4827-ba7d-d65c20be0517 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:35.122444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:35.154970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.156871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.157384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.158082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] PATH_INFO: `/v3/users/be92627072af4172afe51d61b0d19728` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.177316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] RBAC: Authorizing `identity:get_user(user_id=be92627072af4172afe51d61b0d19728)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.179376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.182136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 122/242] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:34 2022] GET /identity/v3/users/be92627072af4172afe51d61b0d19728 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:35.188384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:35.218563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:35.315232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89935c-ad4e-452b-932e-42fd66e05f16 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:35.329231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3ec7-d39b-4213-ae03-ff9cf6ffa870 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:35.354757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.355811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.356289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.356760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.389665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:35.442055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.444114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.492104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.493135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.493573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.494266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.495803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.503241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.572675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 123/243] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:35.578895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:35.586420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 121/244] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:35 2022] POST /identity/v3/users => generated 293 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:35.682565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:35.745562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a257-1808-4623-8208-6cfee53f0479 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:35.795903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.796805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.797086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.797363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.798664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.800549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feacd0-9ade-4b98-a70c-19eb82a5d9e1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.802841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 124/245] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:35 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:35.808694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:35.926129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17805ff0-4d29-41f8-a70e-3f05ff4a80d9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:35.934960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498cce-6465-405c-8a5e-9d3652f7380b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.935559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498cce-6465-405c-8a5e-9d3652f7380b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.936027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f498cce-6465-405c-8a5e-9d3652f7380b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.937965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 125/246] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:35.946330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.946932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.947416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.950022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:35.967247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:35.968934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:35.969143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:35.969831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:35.970151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:35.970432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:35.971276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=be92627072af4172afe51d61b0d19728) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:35.971589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:35.973271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:35.980602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 122/247] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:35 2022] GET /identity/v3/role_assignments?user.id=be92627072af4172afe51d61b0d19728&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=de3b02a88b974173aff5a985001d7665 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:36.070344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 126/248] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:36.094139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:36.238123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bb30c-9273-4e23-b10e-052dee5451a3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:36.276552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:36.277387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.277671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.277971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.290349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:36.298209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:36.299491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:36.300586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 123/249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:36.307612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:36.402213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:36.445816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c94c7-a89d-4c23-b270-ecb6ad6bc0dc None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:36.491664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:36.492303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.492586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.492867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.493673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:36.494015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:36.495512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:36.508232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:36.514319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:36.575794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:36.656174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81109-a5fe-4a62-aae9-1aac3fccc014 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:36.701518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48477019-a692-4250-9a82-1c002d017fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:36.703155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477019-a692-4250-9a82-1c002d017fef None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.703660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477019-a692-4250-9a82-1c002d017fef None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.704129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48477019-a692-4250-9a82-1c002d017fef None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.705646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48477019-a692-4250-9a82-1c002d017fef None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:36.707433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48477019-a692-4250-9a82-1c002d017fef None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:36.710053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 124/251] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:36 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:36.719151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:36.867653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0cf4-a771-405b-8a9a-fe5f370ed358 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:36.894329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:36.918329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:36.919018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.919301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.919581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.932360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e882-1b20-4f8b-b421-734cc231d332 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.933013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e882-1b20-4f8b-b421-734cc231d332 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.933487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291e882-1b20-4f8b-b421-734cc231d332 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.936656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 125/252] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:36.941568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:36.942308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:36.942781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:36.983163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:36.985298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:37.000876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:37.002454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:37.141001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 126/253] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:37.201264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:37.241984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 128/254] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:37.245712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:37.294168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:37.319952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:37.424772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469c12f-a514-447b-b781-6d6a117c7d6e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:37.484954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504105f-e779-4e26-a345-02e1a9860830 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:37.498784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:37.499642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:37.499926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:37.500208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:37.519710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:37.534058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:37.536912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:37.538885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 127/255] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:37.551545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:37.566724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:37.567706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:37.568161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:37.568305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:37.574899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:37.576416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:37.584349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 129/256] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:37 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:37.601170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:37.797060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606ac5a-243b-4374-9cbf-46ee18af7b72 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:37.801266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:37.870164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:37.872422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:37.873221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:37.873861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:37.875389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:37.878738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:37.880518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:37.884790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c985346-0742-4132-99e9-5ea210418a60 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:37.903408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 128/257] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:37.913275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d09a-9a2d-4dd2-bb79-7ffe378671e2 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:37.914224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d09a-9a2d-4dd2-bb79-7ffe378671e2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:37.915717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d09a-9a2d-4dd2-bb79-7ffe378671e2 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:37.918611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 129/258] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:37.921706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d09a-9a2d-4dd2-bb79-7ffe378671e2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:37.928341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f019d-d0d2-4baf-b1dd-57231f48daaa None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:38.040149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:38.041175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.041658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.042167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.043773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=0a3acc20b76540cba877fa303c664a36) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:38.044799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:38.047606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17d1c-7233-4257-ac27-c6aac373a00f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:38.070817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 130/259] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:37 2022] GET /identity/v3/role_assignments?user.id=0a3acc20b76540cba877fa303c664a36&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:38.073098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.073587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.074110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.123961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:38.129440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:38.251161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d09a-9a2d-4dd2-bb79-7ffe378671e2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:38.366868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 131/260] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:38.372620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:38.374289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.374795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.375294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] PATH_INFO: `/v3/users/9b635a7b260641029457c35b621cc8a1` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.383607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] RBAC: Authorizing `identity:get_user(user_id=9b635a7b260641029457c35b621cc8a1)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:38.386571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:38.390100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 130/261] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:37 2022] GET /identity/v3/users/9b635a7b260641029457c35b621cc8a1 => generated 297 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:38.396877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:38.408071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:38.502982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:38.529492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05febe-2013-41d5-8aad-b15dff19cb9e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:38.530527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:38.579705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:38.580640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.580928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.581208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.582771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:38.584414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:38.590200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 132/262] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:38 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:38.593184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:38.721598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6555a4-6f22-46cb-892d-a3ce536c2e90 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:38.765477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:38.766452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.766725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.766998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/9b635a7b260641029457c35b621cc8a1/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.769121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, user_id=9b635a7b260641029457c35b621cc8a1, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:38.773480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:38.802430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:38 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/9b635a7b260641029457c35b621cc8a1/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:32:38.825838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38611-3719-4c86-9bce-9b4d478e2388 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:38.931469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:38.932900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:38.933361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:38.933826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:38.963585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:38.972498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:38.974277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:38.977015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 567 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:32:38.985990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:39.016498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:39.214666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c7eb8-78e0-45a7-a52b-718a1ca035cc None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:39.267729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:39.268349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.268630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.268903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.269665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:39.270035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:39.271442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d04ff9-ac62-4602-94ae-d30f0ce5ad4d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:39.286315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:39.292759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:39.435416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac43bb-5b31-4064-9874-c17632b39487 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.435860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac43bb-5b31-4064-9874-c17632b39487 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.436299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac43bb-5b31-4064-9874-c17632b39487 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.439674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 135/266] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:39.449014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.449324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.449588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.478529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:39.479778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:39.573073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:39.596225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bfa9-a993-4eec-9424-b3f8691b8dc4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:39.621527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 136/267] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:39.658363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:39.659678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.660146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.660652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] PATH_INFO: `/v3/users/0a3acc20b76540cba877fa303c664a36` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.666008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:39.667380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:39.668441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3acc20b76540cba877fa303c664a36)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:39.671211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:39.677501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 132/268] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:39 2022] GET /identity/v3/users/0a3acc20b76540cba877fa303c664a36 => generated 283 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:39.684298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:39.876122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccbbdd-3bf0-42dd-8c2c-6c137103e5d5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:39.901431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f7e4-ecde-4fec-bf3f-bb86de2357e8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:39.940499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:39.941329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.941609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.942092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.961252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:39.966267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:39.966934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:39.967215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:39.967486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:39.978068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:39.978993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:39.979773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:39.980842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 137/269] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:39.990748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.034443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.099184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:40.100686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da01f3-a253-4c92-a4c7-f1d8f9d2d557 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:40.111946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.187598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcaa2-9492-4b8b-8257-81f562b4f63b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:40.231540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 133/270] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:40.231540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf350d-c771-47b5-a5ea-0be32e8d85b7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.231540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf350d-c771-47b5-a5ea-0be32e8d85b7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.231540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf350d-c771-47b5-a5ea-0be32e8d85b7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.231540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 134/271] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:40.232048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fac45-c242-43cb-8367-5642db8d8fb2 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.232118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fac45-c242-43cb-8367-5642db8d8fb2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.233149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fac45-c242-43cb-8367-5642db8d8fb2 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.234464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 135/272] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:40.235177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fac45-c242-43cb-8367-5642db8d8fb2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.256398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:40.257268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.257610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.258493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.258825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:40.259242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:40.261226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85ddd6-4174-4c04-80b0-cd56c5696f67 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:40.271536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 138/273] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:40.272813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5be4c-79b7-468b-a62e-bd1fc3dd269f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.273102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5be4c-79b7-468b-a62e-bd1fc3dd269f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.273378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5be4c-79b7-468b-a62e-bd1fc3dd269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.291564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b8a5be4c-79b7-468b-a62e-bd1fc3dd269f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:40.293218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b8a5be4c-79b7-468b-a62e-bd1fc3dd269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:40.341141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.389055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 139/274] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:40.391480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.392112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.392747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.399254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fac45-c242-43cb-8367-5642db8d8fb2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:40.428141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:40.430046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:40.461493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:40.462839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.463288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.463734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.465425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:40.467935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:40.470760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 136/275] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:40.472082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.520566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.548634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:40.555910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.645668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998bd3b-7930-4ea0-a03a-201201fb54c3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:40.682928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.694880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:40.695784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.696158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.696450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] PATH_INFO: `/v3/users/be92627072af4172afe51d61b0d19728` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.697714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] RBAC: Authorizing `identity:get_user(user_id=be92627072af4172afe51d61b0d19728)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:40.699237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:40.706386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 137/277] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/users/be92627072af4172afe51d61b0d19728 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:40.706386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.719056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a34463-53d0-4dec-9f19-fbbf6ba0c0ed None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:40.767506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:40.768848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.769221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.769736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.790798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:40.806285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:40.808425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:40.810241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:40.811774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:40.813283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.842154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cec67f-12df-4beb-83ad-5c952763b6eb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:40.874402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:40.909255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:40.910115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:40.910966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:40.911262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:40.912690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=0a3acc20b76540cba877fa303c664a36) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:40.913200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:40.915778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:40.934037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 138/279] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/role_assignments?user.id=0a3acc20b76540cba877fa303c664a36&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:40.937554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:40.939049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69b3fe-d9ca-41fa-9abf-6620481eca31 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.004709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.006333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.006825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.007310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.009604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.012484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.022055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 142/280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:41.022055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:41.072589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:41.165699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680a0d6-bb08-414a-80eb-aa06001e5495 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.214645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.215669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.215983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.216226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.217555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.219123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.221431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 139/281] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:40 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:41.222120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:41.261926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e283590-b940-491b-a892-c3baeb5d859d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.278939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:41.308024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.308724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.309005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.309282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.310091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:41.310395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.312342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.326122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 143/282] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:41.326122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:41.422866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a5b4-154e-4d04-8b2c-b226be19ae57 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.471880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed15178-1f87-4b82-9986-9a8b0971507d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.480886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:41.491548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.492252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.492533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.492807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.493546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.495114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.534100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 140/283] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:32:41 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:41.534100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:41.550190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.551949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.552394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.552842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/be92627072af4172afe51d61b0d19728/roles/de3b02a88b974173aff5a985001d7665` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.556353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, user_id=be92627072af4172afe51d61b0d19728, role_id=de3b02a88b974173aff5a985001d7665)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.558987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866a4e8-8ffe-4d95-8251-01d25620bd5b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.590817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 144/284] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:32:41 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/users/be92627072af4172afe51d61b0d19728/roles/de3b02a88b974173aff5a985001d7665 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:41.694730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e986-9577-480b-b500-15a836e571ac None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.695359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e986-9577-480b-b500-15a836e571ac None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.696859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e986-9577-480b-b500-15a836e571ac None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.700743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 145/285] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:41.709596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.710190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.710712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.727199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29df5-c36e-437b-be0e-77535638d369 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:41.738543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:41.740983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:41.803955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:41.805748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:41.806361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:41.806970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] PATH_INFO: `/v3/users/772e13e51c6640f8908a40535b1bd181` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:41.808134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:41.839524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] RBAC: Authorizing `identity:get_user(user_id=772e13e51c6640f8908a40535b1bd181)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:41.842492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:41.845836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 141/286] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:41 2022] GET /identity/v3/users/772e13e51c6640f8908a40535b1bd181 => generated 293 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:41.857400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:41.905607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 146/287] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:41.940775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:41.951524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:42.043544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8fcf-7468-4465-98db-c0718c433447 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:42.093052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:42.094690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:42.095517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:42.096299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:42.098373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, user.id=772e13e51c6640f8908a40535b1bd181, scope.system=all) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:42.099265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:42.102487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:42.110357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 142/288] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Jun 28 17:32:41 2022] GET /identity/v3/role_assignments?user.id=772e13e51c6640f8908a40535b1bd181&scope.system=all&role.id=92f222645a174bcab24981d46e9900f9 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:42.143711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc8a8-38a3-45e7-8ca3-6519fc5973a5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:42.218053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:42.219331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:42.219778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:42.220214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:42.249711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:42.265042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:42.266066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:42.266842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:42.271736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 147/289] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:42.278238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:42.438458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831aa19-6783-436c-abb0-9113d704ce0c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:42.454115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:42.507171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:42.508294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:42.508771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:42.509231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:42.510730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:42.511254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:42.514025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:42.531583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 143/290] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:42.538187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:42.596989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:42.797247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb7ccf-4c56-440d-b099-c122c214ace1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:42.885117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:42.886674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:42.887156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:42.887623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] PATH_INFO: `/v3/users/9b635a7b260641029457c35b621cc8a1` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:42.889769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] RBAC: Authorizing `identity:get_user(user_id=9b635a7b260641029457c35b621cc8a1)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:42.892439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:42.901166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 148/291] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:42 2022] GET /identity/v3/users/9b635a7b260641029457c35b621cc8a1 => generated 297 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:42.907900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:43.121919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1381-9b40-4ec0-92fc-3328f7f42048 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:43.184630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:43.185739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:43.186253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:43.186743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:43.242893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:43.312585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:43.314527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:43.542789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 144/292] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:43.550431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:43.788193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:43.815103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054937cb-f5e6-4364-a2f6-89cb988c4044 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:43.898952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:43.900232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:43.900619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:43.901002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:43.902878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:43.905144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130954f-6762-4e64-9993-252d3ed14739 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:43.908929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 149/293] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:43 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:43.916120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:44.070422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:44.139751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883b04b-6c62-4aa0-b0d6-dc5f128ec3a7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:44.209415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:44.210573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:44.218626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:44.219098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:44.220740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=9b635a7b260641029457c35b621cc8a1) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:44.221281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:44.224273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc83526-e748-4c95-9775-e899efeb8f78 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:44.236526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 145/294] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:43 2022] GET /identity/v3/role_assignments?user.id=9b635a7b260641029457c35b621cc8a1&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=92f222645a174bcab24981d46e9900f9 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:45.220754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301fae-8d29-4c51-956b-2dcee1c87187 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.221879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301fae-8d29-4c51-956b-2dcee1c87187 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.222425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7301fae-8d29-4c51-956b-2dcee1c87187 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.225130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 150/295] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:45.231554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.232534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.233009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.252487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:45.254434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:45.299506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934380d2-d0fd-440e-a530-1d372cddc073 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.300145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934380d2-d0fd-440e-a530-1d372cddc073 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.300619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934380d2-d0fd-440e-a530-1d372cddc073 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.307077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 151/296] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:45.309318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.309837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.310333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.330356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:45.332011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:45.362645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 146/297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:45.388289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:45.469980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 152/298] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:45.479993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:45.489152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:45.553899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10cc5b-3e57-4268-9e99-d012f9c1dc1a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:45.592614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:45.593543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.593886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.594201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.595521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:45.597027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186478fa-03c2-45d8-8848-c2843af35d64 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:45.598969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 147/299] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:45.600151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986326-b7d9-4ee6-986f-1270e94bda57 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.600439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986326-b7d9-4ee6-986f-1270e94bda57 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.600716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0986326-b7d9-4ee6-986f-1270e94bda57 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.602050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 148/300] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:45.603161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6f0e-8d25-48a4-8646-6e992a654490 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.603447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6f0e-8d25-48a4-8646-6e992a654490 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.603724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b6f0e-8d25-48a4-8646-6e992a654490 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.605185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 149/301] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:45.610152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b6f0e-8d25-48a4-8646-6e992a654490 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:45.646576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:45.657895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc37f-a797-4e70-9e18-99d96538d69b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:45.702783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:45.703700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.704065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.704340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.718284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-18b43160-4a51-4749-861b-b71abd724a66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:45.727441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:45.729034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:45.729887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 153/302] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:45.731080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958964-e86f-4721-af90-e4517ab89246 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.731626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958964-e86f-4721-af90-e4517ab89246 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.731925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958964-e86f-4721-af90-e4517ab89246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.755856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-36958964-e86f-4721-af90-e4517ab89246 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:45.758657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-36958964-e86f-4721-af90-e4517ab89246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:45.761660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b6f0e-8d25-48a4-8646-6e992a654490 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:45.801592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:45.808403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:45.809100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.809379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.809653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] PATH_INFO: `/v3/groups` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.810386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:45.811881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947fb91-b5fe-46f2-8026-11b757ce9929 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:45.830729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 150/303] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Jun 28 17:32:45 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:45.833090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:45.833647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:45.834244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:45.861592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:45.863868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:45.875343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 154/304] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:45.875343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958964-e86f-4721-af90-e4517ab89246 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.006100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 151/305] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:46.006100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.040371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.081228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958964-e86f-4721-af90-e4517ab89246 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.144026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.146000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.146000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.146000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.147027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:46.147467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:46.149634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:46.164032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 155/306] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:46.165706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.200601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c8c0-d162-4c56-b961-1bb77e027543 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.228662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.254812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.255963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.256361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.256579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.268698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:46.277089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:46.279366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 152/307] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:46.281190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.370224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5577e-c2df-4657-87dd-636a0c5d858f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.436632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850548bf-e00e-4984-bc7a-c7868ded6bc8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.436883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.437787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.438306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.438794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.458420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:46.473129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:46.474169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:46.474918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:46.475494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 156/308] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:46.478164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.484030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.504599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.505524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.505816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.506138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] PATH_INFO: `/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.530091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] RBAC: Authorizing `identity:get_user(user_id=dfb12e6b26cb49ac9ccdaca532e5d2aa)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:46.531608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:46.533438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 153/309] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:46.534280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.600576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.669593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525e4b7-ca62-4fc5-91c5-1d630d915ab7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.716090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b99a44-f4b8-447a-897f-3f1c192b58f1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.730916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.732047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.732526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.732958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.734170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:46.734487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:46.735955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:46.751514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 157/310] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:46.751514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.790073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.790864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.791288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.791756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.792647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:46.793016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:46.794951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:46.806347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 154/311] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:46.808312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:46.873322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.930411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01cdea-46f2-4cbb-ba99-87967017ba92 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.984953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:46.986793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:46.987811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:46.988273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:46.988742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:46.989925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, user.id=dfb12e6b26cb49ac9ccdaca532e5d2aa, scope.system=all) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:46.990363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f193-e0a4-406c-8a7c-151739a23e3a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:46.990517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:46.992599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.007006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 158/312] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/role_assignments?user.id=dfb12e6b26cb49ac9ccdaca532e5d2aa&scope.system=all&role.id=de3b02a88b974173aff5a985001d7665 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:47.007006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:47.064814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:47.065754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:47.066130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:47.066479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] PATH_INFO: `/v3/users/be92627072af4172afe51d61b0d19728` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:47.068089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] RBAC: Authorizing `identity:get_user(user_id=be92627072af4172afe51d61b0d19728)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:47.069728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.072040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 155/313] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:46 2022] GET /identity/v3/users/be92627072af4172afe51d61b0d19728 => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:47.080195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:47.230087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e98e-1375-45d8-aa18-8b62e6a6ba5b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:47.273890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5456c1c-bc7f-49d8-862e-99f3e44f5e66 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:47.299966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:47.315110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:47.316297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:47.316855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:47.317471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] PATH_INFO: `/v3/users/772e13e51c6640f8908a40535b1bd181` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:47.319290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] RBAC: Authorizing `identity:get_user(user_id=772e13e51c6640f8908a40535b1bd181)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:47.321071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.323986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 159/314] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:47 2022] GET /identity/v3/users/772e13e51c6640f8908a40535b1bd181 => generated 293 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:47.334011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:47.355193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:47.356613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:47.356980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:47.357323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:47.414813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:47.464286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:47.468540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.555345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab127b-ff63-4c7f-a333-672fc495b042 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:47.625222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:47.627880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:47.628600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:47.629332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] PATH_INFO: `/v3/system/users/772e13e51c6640f8908a40535b1bd181/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:47.632321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=772e13e51c6640f8908a40535b1bd181, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:47.635131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.653400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 160/315] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Jun 28 17:32:47 2022] PUT /identity/v3/system/users/772e13e51c6640f8908a40535b1bd181/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:32:47.698427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 156/316] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:47.706538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:47.827331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:47.875681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f6ed-292a-43fb-b71a-84cd83aca461 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:47.917741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:47.919103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:47.919604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:47.920174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:47.921926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:47.924448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da6372-d267-4de9-985b-f664cd6711ba None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:47.926934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 161/317] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:47 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:47.936832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:48.058943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:48.124458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a290ca-e5e7-467f-a249-f6153831494f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:48.183396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:48.184234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:48.184518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:48.184795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:48.185800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792, user.id=be92627072af4172afe51d61b0d19728) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:48.186224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:48.188758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed548c-7a4c-46dd-a221-85bd4fbbc0ca None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:48.199886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 157/318] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:32:47 2022] GET /identity/v3/role_assignments?user.id=be92627072af4172afe51d61b0d19728&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=de3b02a88b974173aff5a985001d7665 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:48.844342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f20b-beeb-4d04-85d9-22f33ef22e8d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:48.844908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f20b-beeb-4d04-85d9-22f33ef22e8d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:48.845283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59f20b-beeb-4d04-85d9-22f33ef22e8d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:48.848095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 162/319] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:48.856591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:48.857150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:48.857539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:48.886408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:48.888391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:49.005161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 158/320] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:49.041833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f20b-beeb-4d04-85d9-22f33ef22e8d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:49.253617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59f20b-beeb-4d04-85d9-22f33ef22e8d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:49.308395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:49.324693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:49.326043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:49.326466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:49.326877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:49.329059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:49.331480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb577e-edec-4425-b2a3-edf0febb92af None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:49.334669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 163/321] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:32:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:49.343043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:49.450003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb3b14-9a09-4d95-b624-7fd79acc40e6 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:49.450307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb3b14-9a09-4d95-b624-7fd79acc40e6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:49.450554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb3b14-9a09-4d95-b624-7fd79acc40e6 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:49.452154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 164/322] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:49.457767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:49.458078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:49.458399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:49.466541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:49.476618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:49.477824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:49.535904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981609b-d561-4c56-a1ca-851926d8b2b0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:49.593099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 165/323] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:49.595203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:49.596484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:49.597140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:49.597814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] PATH_INFO: `/v3/groups` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:49.599607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:49.611148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:49.617100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:49.635596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 159/324] 10.222.0.48 () {60 vars in 1134 bytes} [Tue Jun 28 17:32:49 2022] POST /identity/v3/groups => generated 226 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:32:49.792696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6e463-a529-4e63-9a96-bb6bc53df6a8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:49.828706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:49.841251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:49.842184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:49.842469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:49.842808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:49.856780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:49.865073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:49.866623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:49.868086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 166/325] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:49.876130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:50.019796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc91277-88ee-43b1-a140-a9590f18486e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:50.056535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:50.079381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:50.080549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.081026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.081503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.083224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:50.083792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:50.086509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c27379-157b-4621-8daa-98e317aacb3c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:50.103044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 160/326] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:50.109742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:50.265577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaee74-770d-4bdd-b4f6-fee815d6257b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:50.305323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:50.306626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.307150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.307725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] PATH_INFO: `/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.309262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] RBAC: Authorizing `identity:get_user(user_id=dfb12e6b26cb49ac9ccdaca532e5d2aa)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:50.310220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684b08-b880-4d36-9143-71cafe5737c5 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.310691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684b08-b880-4d36-9143-71cafe5737c5 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.311163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f684b08-b880-4d36-9143-71cafe5737c5 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.311448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:50.313764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 161/328] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:50.315079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 167/328] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:50 2022] GET /identity/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:50.319726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:50.320339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.320848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.321321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.343296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:50.345054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:50.402185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:50.443483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 162/329] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:50.468899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:50.472521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc3128-ba96-4da3-9d1b-db50f9c7e837 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:50.523600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:50.524549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.524827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.525100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] PATH_INFO: `/v3/system/users/dfb12e6b26cb49ac9ccdaca532e5d2aa/roles/de3b02a88b974173aff5a985001d7665` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.527581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dfb12e6b26cb49ac9ccdaca532e5d2aa, role_id=de3b02a88b974173aff5a985001d7665)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:50.529014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:50.546037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 168/330] 10.222.0.48 () {58 vars in 1334 bytes} [Tue Jun 28 17:32:50 2022] PUT /identity/v3/system/users/dfb12e6b26cb49ac9ccdaca532e5d2aa/roles/de3b02a88b974173aff5a985001d7665 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:32:50.614062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410ef1b-de9a-4c2c-a8b0-bc3b95f8c16e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:50.639222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:50.676332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:50.677609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.677895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.678210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.692064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:50.703218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:50.705473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:50.707301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 163/331] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:50.711439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:50.864175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34c3f-a626-4109-9574-e263ee168465 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:50.887232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:50.911215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:50.912793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:50.913085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:50.913356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:50.914249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:50.914600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:50.916206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:50.928571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 169/332] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:50.934218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:51.076946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf08f02-47b1-4546-88f0-b060679ab44c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:51.130137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:51.131085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:51.131355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:51.131632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] PATH_INFO: `/v3/users/772e13e51c6640f8908a40535b1bd181` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:51.133024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] RBAC: Authorizing `identity:get_user(user_id=772e13e51c6640f8908a40535b1bd181)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:51.134562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c038b-7b16-4ed7-b247-2c27821f4c87 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:51.136689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 164/333] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:50 2022] GET /identity/v3/users/772e13e51c6640f8908a40535b1bd181 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:32:51.143280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:51.316113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb54da-22eb-4b02-85d8-4a51e1e839c2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:51.372528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:51.373234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:51.373520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:51.373803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:51.374697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] RBAC: Adding query filter params (role.id=92f222645a174bcab24981d46e9900f9, user.id=772e13e51c6640f8908a40535b1bd181, scope.system=all) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:51.375014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:51.376542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13c4d-bef4-4e2d-92d0-9e74eaaf20d6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:51.395445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 170/334] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Jun 28 17:32:51 2022] GET /identity/v3/role_assignments?user.id=772e13e51c6640f8908a40535b1bd181&scope.system=all&role.id=92f222645a174bcab24981d46e9900f9 => generated 510 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:53.334821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16250-096d-42cb-9904-15355f33e53a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.335547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16250-096d-42cb-9904-15355f33e53a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.335547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac16250-096d-42cb-9904-15355f33e53a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:53.337100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 165/335] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:53.346008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.346744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.346744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:53.371068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:53.372302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:53.396971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c2c8-a31a-48f1-b0f0-4789aa7229a9 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.398084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c2c8-a31a-48f1-b0f0-4789aa7229a9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.398834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0c2c8-a31a-48f1-b0f0-4789aa7229a9 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:53.405516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 166/336] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:53.408141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.408632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:53.409052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.409516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:53.453861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:53.460301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:53.476587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 171/337] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:53.548493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:53.566440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:53.680374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 167/338] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:53.714507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31f8ca-7ed4-435b-a0fb-840b511ed6e5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:53.724629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:53.768564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:53.769412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.769780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.771315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:53.797409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:53.805926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:53.807632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:53.809167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:53.819678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 172/339] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:53.823180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:53.900543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:53.937618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05624b-98e0-4c41-83c7-79ead03624fe None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:53.994241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:53.995298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:53.995630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:53.995876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:54.008704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:54.020147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:54.021790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:54.023364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 168/340] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:54.029542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:54.087213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:54.127743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dbd5a-8641-483a-b7a1-22163f82327d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:54.194858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076a077-3a43-467d-9ef8-566bb40dc1f8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:54.195097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:54.195503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:54.195790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:54.196067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:54.196854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:54.197166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:54.198673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:54.208571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 173/341] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:54.216734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:54.252925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:54.252925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:54.252925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:54.252925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:54.253545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:54.253545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:54.254218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:54.268514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 169/342] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:54.275572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:54.454914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:54.487306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a3a67-e7ca-4361-9d7d-9b24c99243f2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:54.531646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:54.550490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01edd-8376-4028-aff0-4354b4039acd None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:54.597344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:54.598466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:54.598911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:54.599631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:54.667689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:54.668913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:54.669406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:54.669892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:54.813844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:54.816820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea989f16-d0d5-480c-9833-a4d63fb4e50b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:54.906616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:54.909974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fd65-9304-41e7-b851-625c5cabaf8d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:55.114014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.133603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 174/343] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 917 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:55.134672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.135572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4024-e0d3-4b71-999c-deac8ce0a3ec None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.136033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4024-e0d3-4b71-999c-deac8ce0a3ec None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.136459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4024-e0d3-4b71-999c-deac8ce0a3ec None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.138589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 175/344] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:55.140443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ed91-f38c-4a6a-9f9e-947525c616de None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.140885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ed91-f38c-4a6a-9f9e-947525c616de None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.141317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ed91-f38c-4a6a-9f9e-947525c616de None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.143249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 176/345] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:55.144236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ed91-f38c-4a6a-9f9e-947525c616de None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.153072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 170/346] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 879 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:32:55.155481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b1ec-f34a-48eb-bc0b-6317680af1d6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.155771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b1ec-f34a-48eb-bc0b-6317680af1d6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.156049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b1ec-f34a-48eb-bc0b-6317680af1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.184221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-21a1b1ec-f34a-48eb-bc0b-6317680af1d6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:55.185661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-21a1b1ec-f34a-48eb-bc0b-6317680af1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:55.282107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 171/347] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:55.284062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.284695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.285170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.305896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:55.307639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:55.331112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ed91-f38c-4a6a-9f9e-947525c616de None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.389399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 172/348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:55.390713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.397312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:55.398881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.399364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.399855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.402596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:55.405190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:55.408582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 177/349] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:55.410039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.461886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.516726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dacba-dc47-444f-bb03-abbb29233ead None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.524307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.561439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:55.563440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.563916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.564325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.565903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:55.568860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:55.571327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 173/350] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:55.572443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.619455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a745-a169-430c-bddc-e705e52daac6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.689406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:55.690939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.691386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.692671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.705456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612ac7a-b0e2-4c80-b0f8-172acd73e1ea None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.708722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:55.717515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:55.719380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 178/351] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:55.720909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.754343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.780119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:55.780354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.780550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.780822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.788186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:55.789673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:55.792253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 174/352] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:55.793093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:55.866638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a915-a202-4eba-921a-10df238c6d9d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.902465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:55.937862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:55.939262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.939782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.940392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.948585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b233-494f-4cf1-aa00-0a7d8704bfb4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:55.961823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ed1cf270-74db-4aaf-8cb2-1a028b1aecf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:55.978324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:55.980095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:55.982377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 179/353] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:55.983821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60726-5ef4-4031-bd8b-3551f5a76283 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:55.983821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60726-5ef4-4031-bd8b-3551f5a76283 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:55.983821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60726-5ef4-4031-bd8b-3551f5a76283 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:55.986596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 180/354] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:55.987969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60726-5ef4-4031-bd8b-3551f5a76283 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.006367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.007709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.008128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.008555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.010581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:56.012994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0581e2-da09-48f9-98d8-250ec5060a68 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:56.015848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 175/355] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:56.018148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ed631-3828-4313-ae88-98d19fab417b None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.018576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ed631-3828-4313-ae88-98d19fab417b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.018994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ed631-3828-4313-ae88-98d19fab417b None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.021969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 176/356] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:56.023334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ed631-3828-4313-ae88-98d19fab417b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.128731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:56.151874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb60726-5ef4-4031-bd8b-3551f5a76283 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.196647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ed631-3828-4313-ae88-98d19fab417b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.212400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.213213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.213496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.213779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.215164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:56.215472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:56.216886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:56.228953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 181/357] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:32:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:56.228953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.254625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.255778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.256055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.256335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.257189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=0f00826bf8af4727b1fa61605778bb4c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:56.257506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:56.259087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e781f-2e36-4f45-810d-a4ad55243c65 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:56.266821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 177/358] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=92f222645a174bcab24981d46e9900f9 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:56.267849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.268137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.268416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.293337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:56.295515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:56.306349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:56.429837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 178/359] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:56.431974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.443365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df140a57-73cd-4b6d-b425-4e17369461b6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.516151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.521146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.521146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.521146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.521146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:56.521146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:56.522628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b977a9-fe73-43f2-89e8-6c99d45038c2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:56.532720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:56.536608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 182/360] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:56.538376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.538657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.538956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.574162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:56.575516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:56.634731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15d5c9-a5e8-4fd8-9df7-a83907d5a01c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.687977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 183/361] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:56.689844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.713408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.714881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.715361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.715825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.717387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=0f00826bf8af4727b1fa61605778bb4c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:56.717921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:56.721665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:56.737108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 179/362] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:56.738649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.765837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:56.894078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be0157-8e0a-478f-9fc9-ff9ce57fa179 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.911892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:56.918396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdc04c-4f26-4c82-bf05-b31a43129095 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:56.941254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.943397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.943891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.944339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:56.959011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:56.967504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:56.968480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:56.969249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:32:56.972279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 180/363] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:56.974206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:56.989601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:56.990482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:56.990932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:56.991434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:57.106040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc1071-6ff3-4305-94bf-b2b3cb15b970 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:57.122367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:57.125041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:57.154511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:57.155883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:57.156183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:57.156461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:57.185345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:57.234530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:57.256073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:57.257599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:57.354671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 184/364] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:57.355568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:57.432498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 181/365] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:57.437989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:57.576518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c379f2-f54e-48f0-9191-ed73b2ee4b95 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:57.603008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:57.665162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:57.677577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:57.679252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab5c0c-3c97-4b02-9941-49bd852daaf1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:57.680165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:57.680922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:57.681672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:57.707017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:57.728065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:57.729761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 28 17:32:57.731274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:57.732372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 185/366] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:57.734690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:57.763856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:57.764978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:57.765449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:57.765927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:57.772183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:57.772183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:57.774352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:57.796454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 182/367] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:57.796454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.006705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b250529-a6d9-4922-8e8b-2a978a3aea6e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.037927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f056d-f0be-416c-be9c-59a04032e841 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.080910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.081833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.082432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.082716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.084116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.085756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.088186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 186/368] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:57 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.088380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.115903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.117780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.118502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.119254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] PATH_INFO: `/v3/projects/bd23346f45c341b78a895818770ee4ca` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.123517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] RBAC: Authorizing `identity:get_project(project_id=bd23346f45c341b78a895818770ee4ca)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.126702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.130885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 183/369] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:57 2022] GET /identity/v3/projects/bd23346f45c341b78a895818770ee4ca => generated 344 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.132854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.146005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.170946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.223011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32aa17-b439-4464-9cfa-f697155f4871 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.277099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.278213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.278679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.279141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.280511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:58.281021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.283596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.315772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 187/370] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.318122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.353236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a766e8-c157-4055-98b8-99e231ab8c90 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.428792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.430891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.431696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.432381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.544839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1bc123-1ff2-44e6-9742-3d2f77e42063 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.574294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.576083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.578927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.581291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.598093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.599963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.600691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.601141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.602692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.604576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.607305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 188/371] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.608504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.742588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 184/372] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:32:58.744474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.747586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cb670-c56e-438c-af6b-2589b3057286 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.802450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.803362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.803829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.804189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] PATH_INFO: `/v3/groups/bb58c8c9b0794c9197e149d791cf7db0` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.817291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] RBAC: Authorizing `identity:get_group(group_id=bb58c8c9b0794c9197e149d791cf7db0)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.820772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.824794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 189/373] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/groups/bb58c8c9b0794c9197e149d791cf7db0 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.826319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:58.894733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8745c-c2ce-485d-9189-b82c9ca27cd8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:58.897492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.907492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:58.940534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:58.941900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:58.942671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:58.943141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] PATH_INFO: `/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:58.944692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] RBAC: Authorizing `identity:get_user(user_id=dfb12e6b26cb49ac9ccdaca532e5d2aa)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:58.946537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:58.948492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 185/374] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/users/dfb12e6b26cb49ac9ccdaca532e5d2aa => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:58.949604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.002464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095259e-ee2a-424a-825d-a56e340e7b1b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.064746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.065372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.066134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.066582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d352cb-a640-4f19-b37e-2a71f462b067 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.066860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.068607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:59.069640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.072302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.084143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 190/375] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.086282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.110106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.111348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.111800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.112217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.114307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.116565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.119739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 186/376] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:32:58 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.121595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.183199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:59.252117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1231daa-71f6-4fb1-8f09-5f34d2a5c580 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.261435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceb439-a4cc-4211-abe2-ca97e5f23e5b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.273719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:59.294528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.295644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.296120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.296590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.297735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] RBAC: Adding query filter params (group.id=bb58c8c9b0794c9197e149d791cf7db0, role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=bd23346f45c341b78a895818770ee4ca) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:59.298327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.300613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.308190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.308899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.309106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 191/377] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/role_assignments?group.id=bb58c8c9b0794c9197e149d791cf7db0&scope.project.id=bd23346f45c341b78a895818770ee4ca&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.309230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.309469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.310350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] RBAC: Adding query filter params (role.id=de3b02a88b974173aff5a985001d7665, user.id=dfb12e6b26cb49ac9ccdaca532e5d2aa, scope.system=all) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:59.318263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.318263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d585d-6845-4d1a-80b6-979449658063 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.318845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.327984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 187/378] 10.222.0.48 () {56 vars in 1308 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/role_assignments?user.id=dfb12e6b26cb49ac9ccdaca532e5d2aa&scope.system=all&role.id=de3b02a88b974173aff5a985001d7665 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.349488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe38a4-0ab4-4ff9-969b-417b87791402 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.349733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe38a4-0ab4-4ff9-969b-417b87791402 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.349808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe38a4-0ab4-4ff9-969b-417b87791402 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.354624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 188/379] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:32:59.359839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b739-6123-4644-8cdb-97293abd802c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.360174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b739-6123-4644-8cdb-97293abd802c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.360393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b739-6123-4644-8cdb-97293abd802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.419481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ff64b739-6123-4644-8cdb-97293abd802c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:59.421035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ff64b739-6123-4644-8cdb-97293abd802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:59.597615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8917b-c3dc-4c01-8108-ef784cc2201b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.601339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 189/380] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:32:59.607265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb06f-d1ea-41ba-aefe-0389edffa7d8 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.607265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb06f-d1ea-41ba-aefe-0389edffa7d8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.607542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb06f-d1ea-41ba-aefe-0389edffa7d8 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.608938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 190/381] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:32:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:32:59.615658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.615824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.616050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.649168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:32:59.651780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:32:59.666061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.668888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.669182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.669451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.672026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.672999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.676721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 192/382] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.676721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.690950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:59.766739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:32:59.782236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 191/383] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:32:59.783811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.835216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd19ed-e6f2-40ca-a18e-bf01fd3476a8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.876626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.877814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.878339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.878826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.892335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:32:59.900781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:32:59.901724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:32:59.902547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:32:59.905363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 193/384] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:32:59.910755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:32:59.940968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dae6a-6603-41e2-bd84-1ac1154191ed None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:32:59.985751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:32:59.986521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:32:59.986804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:32:59.987079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:32:59.987933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:32:59.988248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:32:59.989883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:32:59.996638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=92f222645a174bcab24981d46e9900f9 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:32:59.997605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.034573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.035039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4aa54-0d53-4f12-aede-d3fbade9f514 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.048277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.083118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.084170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.084690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.085161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.100294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:00.109685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:00.111016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:00.111799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:00.115010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:00.123476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.143273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d455b6e-4f9e-48fb-9979-f928725cc3f9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.201239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.202680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.203574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.204051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.205038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:00.205541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.208042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.224751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 193/387] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:32:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:00.230359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.340030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434173-17e8-45e9-bfe8-4cd9fec2d5e2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.393611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.394826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.395466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.396628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.397656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:00.398340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.402715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.422667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 195/388] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:00.432783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.450499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.489892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15a4bd-29fd-4b63-adc6-8dbeb247750e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.503535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.563511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.566228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.568280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.569648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.571297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.573015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.575587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 194/389] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:00 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:00.583123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.633748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0bf7e-257a-46c9-b5b2-a74830f7391c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.691985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.692892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.693177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.693453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.694712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.696194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.698184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 196/390] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:00 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:00.711031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.732479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c37be9-72ee-4004-9680-66e6f47a9b63 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.795052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.796723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.798075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.799277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.802456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.805736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.807801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 195/391] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:00 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:00.813681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:00.861084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.897851 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:00.902111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4774-aaf4-458e-b292-69163c100056 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:00.950480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:00.951697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:00.952844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:00.953334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:00.955910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:00.957924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:00.961153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 197/392] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:00 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:00.971222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:01.038405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31388-8204-44cb-9f6d-3d596014434b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:01.112148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:01.113097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:01.113501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:01.113815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:01.119123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, group_id=26bc3fba919c4ce8b51bb30a4f5683b4, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:01.124435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76ca63-731a-4881-8f56-c40974e1b89a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:01.145671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 196/393] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Jun 28 17:33:00 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:01.148619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33557b4c-50cd-4874-96c3-04909bb7e747 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:01.187858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:01.188789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:01.189074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:01.189378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:01.191897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=0f00826bf8af4727b1fa61605778bb4c, group_id=26bc3fba919c4ce8b51bb30a4f5683b4, role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:01.193456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9c547-c4fa-4e60-b03e-a92ff7fe2bcf None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:01.220270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 198/394] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Jun 28 17:33:00 2022] PUT /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:01.688850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac661d-8950-4906-8c53-31867f81afa3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:01.689352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac661d-8950-4906-8c53-31867f81afa3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:01.689843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac661d-8950-4906-8c53-31867f81afa3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:01.692710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 197/395] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:01.700746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5d10-000c-4376-b89f-815dd246c1c8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:01.701450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5d10-000c-4376-b89f-815dd246c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:01.701769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5d10-000c-4376-b89f-815dd246c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:01.737498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b8ef5d10-000c-4376-b89f-815dd246c1c8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:01.739676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b8ef5d10-000c-4376-b89f-815dd246c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:01.790383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:01.885585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 199/396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:01.926091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac661d-8950-4906-8c53-31867f81afa3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:02.051560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:02.081438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4c64-5d02-4d16-9e7f-29a2401e5a9d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.081721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4c64-5d02-4d16-9e7f-29a2401e5a9d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.082123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e4c64-5d02-4d16-9e7f-29a2401e5a9d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.084101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 200/397] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:02.092532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.092940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.093118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.097282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac661d-8950-4906-8c53-31867f81afa3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:02.127274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:02.130396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:02.158180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:02.159073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.159358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.161477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.184938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:02.202502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:02.204205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:02.205747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:02.209962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 198/398] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:02.221818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:02.290385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 201/399] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:02.335548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:02.398901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be978d9d-b0dd-4b78-82d7-4e31d6f3e06b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:02.440488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:02.441212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.442211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.442211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.443230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:02.443541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:02.445269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:02.451381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:02.457410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 199/400] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:02.467443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:02.653480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b1ebf-197a-47d9-8d36-1b5f43f0c88b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:02.673415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:02.699333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c6ab1-54ff-4857-a91e-5239a96ff977 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:02.769875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:02.772133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.772819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.773587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.812432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:02.813896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:02.814422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:02.814908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:02.816930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:02.827399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:02.830210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:02.833701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:02 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:02.841748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:02.858498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:02.860299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:02.863616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 202/402] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 527 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:02.879943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:03.006551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:03.084812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212bb15-326a-4a86-84bc-31dac2b012f6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:03.163466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:03.166311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.166820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.167336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.170973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:03.174134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:03.186239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:02 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:03.187034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b350e9b-5ea0-49a8-a8c5-4c8da115decd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:03.195665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:03.250450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:03.252218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.253000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.253957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.255829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:03.256952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:03.260081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:03.277841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:03.287279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:03.323124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:03.520871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c671c6-36a7-4760-b110-3a341d7c3023 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:03.565192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f6d19-b47f-4f31-9d5b-eb8914179fe3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:03.587127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:03.588572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.589056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.589517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] PATH_INFO: `/v3/groups/bb58c8c9b0794c9197e149d791cf7db0` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.591567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] RBAC: Authorizing `identity:get_group(group_id=bb58c8c9b0794c9197e149d791cf7db0)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:03.594465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a3d6d2-0433-4023-9f3b-27f7ccdd791c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:03.597386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 204/405] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:03 2022] GET /identity/v3/groups/bb58c8c9b0794c9197e149d791cf7db0 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:03.599837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05bbd-65a3-466e-8a12-4a74a4e2aadd None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.600340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05bbd-65a3-466e-8a12-4a74a4e2aadd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.600826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c05bbd-65a3-466e-8a12-4a74a4e2aadd None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.603823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 205/406] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:03.612124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cbf11-2aed-48df-b3b2-b175d9e10c0e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.612588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cbf11-2aed-48df-b3b2-b175d9e10c0e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.613060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cbf11-2aed-48df-b3b2-b175d9e10c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.623054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:03.625018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.625517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.626048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.630270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, group_id=26bc3fba919c4ce8b51bb30a4f5683b4, role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:03.633097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:03.638863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:03.642711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a23cbf11-2aed-48df-b3b2-b175d9e10c0e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:03.644970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a23cbf11-2aed-48df-b3b2-b175d9e10c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:03.659084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 202/407] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Jun 28 17:33:03 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:03.660994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:03.741981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 206/408] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:33:03.741981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613243-435c-4bab-9202-f5b3b63df189 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.741981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613243-435c-4bab-9202-f5b3b63df189 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.741981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613243-435c-4bab-9202-f5b3b63df189 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.744536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 207/409] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:03.746864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.747182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.747446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.770085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:03.770085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:03.770085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:03.864168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2c7f-1b42-455d-b328-c6d9ac925922 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:03.898118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 208/410] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:33:03.899274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:03.945096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:03.946625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:03.947113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:03.947612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] PATH_INFO: `/v3/projects/bd23346f45c341b78a895818770ee4ca` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:03.951092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] RBAC: Authorizing `identity:get_project(project_id=bd23346f45c341b78a895818770ee4ca)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:03.953882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:03.958286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 203/411] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:03 2022] GET /identity/v3/projects/bd23346f45c341b78a895818770ee4ca => generated 344 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:03.959768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:04.090831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:04.131807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460eee65-fe8f-4e82-bf6d-ea044b03db9d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.156525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59833c7a-c915-4375-865c-d5ef9dda5091 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.216410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.218830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.219974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.220722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.226343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.227891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.228471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.229039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.236873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:04.248331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:04.252128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:04.264786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:04.266503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:04.267938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:04.269109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:04.271933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:04.274512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 204/412] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:04.279266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:04.279784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 209/413] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:04.286817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:04.499608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a37290-c270-4b65-b162-4a22fb7519d6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.505049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c5216-2e50-4e9e-bdd5-55577032fc30 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.554255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:04.554886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.555590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.555862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.556140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.556904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:04.557210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:04.558684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:04.569071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 210/414] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:04.570025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:04.584466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.586375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.587106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.587774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] PATH_INFO: `/v3/projects/bd23346f45c341b78a895818770ee4ca/groups/bb58c8c9b0794c9197e149d791cf7db0/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.591093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd23346f45c341b78a895818770ee4ca, group_id=bb58c8c9b0794c9197e149d791cf7db0, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:04.593737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3b3a-acef-4e81-a8ef-6998ad51ba85 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:04.615756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Jun 28 17:33:04 2022] PUT /identity/v3/projects/bd23346f45c341b78a895818770ee4ca/groups/bb58c8c9b0794c9197e149d791cf7db0/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:04.618493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c902e-ce3c-419b-bf28-0b29d639c9e7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.618937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c902e-ce3c-419b-bf28-0b29d639c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.619373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c902e-ce3c-419b-bf28-0b29d639c9e7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.622141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 206/416] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:04.623342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c902e-ce3c-419b-bf28-0b29d639c9e7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:04.701827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:04.791976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252fffb-4551-45da-a7a1-e5dd0b30a80c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.857146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c902e-ce3c-419b-bf28-0b29d639c9e7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:04.861845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.862630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.863071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.863488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.865233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] RBAC: Adding query filter params (name=member) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:04.865547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:04.867285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdbacc-9829-42ad-aeca-3563b009e37e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:04.881105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 211/417] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:04.882439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.882880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.883261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.909761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:04.912702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:04.914646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:04.916057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:04.916521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:04.916964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:04.919287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:04.921734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:04.924863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 207/418] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:04 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:04.930520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.049795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:05.066125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 212/419] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:05.068433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.157542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:05.171162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4b4aa-6cb5-40c3-b6d0-01f41f7ffada None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:05.245235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:05.247228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:05.247980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:05.248616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:05.265136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115b82-9b9f-496c-9995-ea18422a0c75 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:05.304017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:05.305024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:05.305303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:05.305578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:05.307359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:05.309173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:05.311575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 213/420] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:05 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:05.312417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.386443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:05.389713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:05.453135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf980b-a549-432a-9bef-717e8d4295f2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:05.492441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:05.496147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:05.517031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300680-74ab-4993-8803-27b2085554eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:05.518391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300680-74ab-4993-8803-27b2085554eb None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:05.518855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300680-74ab-4993-8803-27b2085554eb None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:05.519312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300680-74ab-4993-8803-27b2085554eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:05.538466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300680-74ab-4993-8803-27b2085554eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-67300680-74ab-4993-8803-27b2085554eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:05.555065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:05.557047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:05.558623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:05.562430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 214/421] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:05.563862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300680-74ab-4993-8803-27b2085554eb None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.606006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 208/422] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:05.608222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.752318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300680-74ab-4993-8803-27b2085554eb None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:05.809224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397e52f-a253-453d-889a-0686362fb5a6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:05.834132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:05.835612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:05.836083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:05.836538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:05.840068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd31cc4ee70a428d9c8242888ec0f792, group_id=26bc3fba919c4ce8b51bb30a4f5683b4, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:05.842755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:05.874399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 215/423] 10.222.0.48 () {58 vars in 1442 bytes} [Tue Jun 28 17:33:05 2022] PUT /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792/groups/26bc3fba919c4ce8b51bb30a4f5683b4/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:05.876006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.884011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:05.885611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:05.886303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:05.886923 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:05.890271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:05.891084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:05.893981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:05.912164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 209/424] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:05.919940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:05.983079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:06.038485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:06.179018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1aceab-a7a7-46c4-aad1-beeb11ae3006 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:06.230315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:06.231002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:06.231284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:06.231566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:06.242564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d264f-7e74-433b-b39a-e1a6148fc0b5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:06.309100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:06.310388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:06.311650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:06.312099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:06.314069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:06.317230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0bc16-8ea6-4b7b-8766-63ed825632fd None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:06.320690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 216/425] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:05 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:06.322613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076222a4-2f07-4e3e-a804-dc4b13aa7830 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:06.323537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076222a4-2f07-4e3e-a804-dc4b13aa7830 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:06.324265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076222a4-2f07-4e3e-a804-dc4b13aa7830 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:06.330263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 217/426] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:06.332368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076222a4-2f07-4e3e-a804-dc4b13aa7830 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:06.335402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:06.337338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c8c50-23b6-4429-9801-47a1b0003983 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:06.364493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:06.518255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 210/427] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:33:06.520979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:06.521470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:06.521972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:06.542861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076222a4-2f07-4e3e-a804-dc4b13aa7830 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:06.557136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:06.564557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:06.573972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:06.674001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:06.674209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:06.677969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:06.677969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:06.681966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:06.681966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:06.689122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 218/428] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:06 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:06.692323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:06.848217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:06.853967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.005539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:07.094091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04128b63-83ba-4828-83f0-25faadf064e2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:07.094274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff580-6d0c-45b1-91d0-c78ddb68921d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:07.141984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:07.141984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.141984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.141984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.142763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=0f00826bf8af4727b1fa61605778bb4c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:07.142763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:07.143023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:07.157977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 212/430] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:33:06 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=92f222645a174bcab24981d46e9900f9 => generated 611 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:07.157977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.237970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:07.246971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.249975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.249975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] PATH_INFO: `/v3/projects/0f00826bf8af4727b1fa61605778bb4c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.265473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] RBAC: Authorizing `identity:get_project(project_id=0f00826bf8af4727b1fa61605778bb4c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:07.268225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:07.286786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 219/431] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:06 2022] GET /identity/v3/projects/0f00826bf8af4727b1fa61605778bb4c => generated 298 bytes in 597 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:07.298132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.313862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811a6cd-d9f1-4f75-912d-6f045f6f2ec4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:07.341982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:07.424385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:07.425597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.426402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.426882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.441989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:07.442534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-37717ef1-b82f-4280-b985-9f6d22c678f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:07.451911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:07.452850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:07.453633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:07.465443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 213/432] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:33:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:07.465443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fff4-f468-4db8-a3ec-9522c5356fec None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.465443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fff4-f468-4db8-a3ec-9522c5356fec None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.465443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fff4-f468-4db8-a3ec-9522c5356fec None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.466059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 214/433] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:07.471617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072fff4-f468-4db8-a3ec-9522c5356fec None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.560942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692f66-2d66-4f88-ab7b-3171d5d7de05 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:07.636659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:07.641466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.642413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.643143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.645798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:07.648907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd7ee0-6448-4ad5-a4f8-978f2543dace None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:07.655254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 220/434] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:07 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:07.659346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.660234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.661029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.680751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072fff4-f468-4db8-a3ec-9522c5356fec None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:07.697909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:07.699990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:07.757252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:07.758721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:07.759381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:07.760027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:07.761516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:07.762467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:07.765212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:07.782686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 215/435] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:07.785442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.834949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 221/436] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:07.836843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:07.876529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:07.936985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.007925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8050e2-3fd3-45e8-bc98-751472af72fc None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.025296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a02446-22de-43cf-aa1a-eeb6aaa3d17c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.058663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.059450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.059861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.060257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.061291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=0f00826bf8af4727b1fa61605778bb4c) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:08.061723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.063449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.082018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 216/437] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:33:07 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=0f00826bf8af4727b1fa61605778bb4c&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 611 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:08.082018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.102750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.104052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.104620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.105324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.253042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.256591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.262322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.276913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf512400-0741-4c2a-be68-cfc19a4edba4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.360003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.361639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.362637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.363092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.364549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.387563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:08.399178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:08.400113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:08.400868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:08.401453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 217/438] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:08.409103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.452781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 222/439] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:08.458094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.572837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a014-96fe-4f6a-9268-0e1deed3d9b3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.615643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb331830-30cf-4651-9efd-fe4b761460a5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.623280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.623964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.625369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.625369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.625369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:08.625750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.627336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2d947-d561-4f46-bb77-efd8f5df8af8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.638937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 218/440] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:08.640087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ba19-c18a-4958-8f1b-b11b9ddeb8ee None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.640376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ba19-c18a-4958-8f1b-b11b9ddeb8ee None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.640651 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ba19-c18a-4958-8f1b-b11b9ddeb8ee None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.642272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 219/441] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:08.648863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ba19-c18a-4958-8f1b-b11b9ddeb8ee None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.670546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.671625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.672518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.672801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.673069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.674748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.676333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f58906-3382-45ee-a1be-db14762ece49 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.678103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 223/442] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:08.679326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.679607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.679879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.697337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:08.698592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:08.701826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.774526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 224/443] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:08.775842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ba19-c18a-4958-8f1b-b11b9ddeb8ee None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.776035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.820442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.821209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.821855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.821855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.904956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10b213-d77d-4c59-8a31-8f1b17872bb4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:08.905154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.906414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.925504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:08.942502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:08.943383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:08.943663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:08.943936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:08.945158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:08.946632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:08.948278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 225/444] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:08.949064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:08.960566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.024768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 220/445] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:09.026331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.068347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade64e-dd4a-4ce6-9236-68e1177bcee7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.106071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.107116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.107257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.107465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.119609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:09.128119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:09.130182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 226/446] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:09.132324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.161482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817590-4675-4477-94c2-57b024f5d40a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.182148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.211650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.212597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.213019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.213451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.214967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:09.215456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.217972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.228869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 221/447] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:09.229814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.242421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.309802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe4637-86a3-49e8-8b6d-ac3eb2597c23 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.370555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33f623-acd9-44dd-a490-935fdfdb844b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.375544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.377168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.377659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.378256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] PATH_INFO: `/v3/projects/bd23346f45c341b78a895818770ee4ca` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.380609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] RBAC: Authorizing `identity:get_project(project_id=bd23346f45c341b78a895818770ee4ca)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.383230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.391190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 227/448] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/projects/bd23346f45c341b78a895818770ee4ca => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:09.393447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.435507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.436577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.437072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.437563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.439031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:09.439582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.442452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.459791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 222/449] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:09.467138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.521783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.537225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874a649-ae84-4ed6-ada3-b3fd352f349c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.583891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.584775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.585047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.585337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] PATH_INFO: `/v3/groups/bb58c8c9b0794c9197e149d791cf7db0` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.586631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] RBAC: Authorizing `identity:get_group(group_id=bb58c8c9b0794c9197e149d791cf7db0)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.588107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.589781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 228/450] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/groups/bb58c8c9b0794c9197e149d791cf7db0 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:09.591474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de520a-75b4-4c6e-8ded-3cfe1c5521b3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.595674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.599789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.637106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.638092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.638928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.639219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.721232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfda57-2943-4ab3-aa32-6a6ccbc0e9ef None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:09.735953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.737485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.763837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:09.764502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:09.764784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:09.765060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:09.765901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] RBAC: Adding query filter params (group.id=bb58c8c9b0794c9197e149d791cf7db0, role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=bd23346f45c341b78a895818770ee4ca) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:09.766257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:09.767709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:09.775515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 229/451] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/role_assignments?group.id=bb58c8c9b0794c9197e149d791cf7db0&scope.project.id=bd23346f45c341b78a895818770ee4ca&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:09.802217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:09.883145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 223/452] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:33:09.889270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:09.973143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:10.010301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026633d-9e05-4b82-9c87-ca0660a3b974 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:10.046493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:10.047386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:10.047661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:10.047924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] PATH_INFO: `/v3/projects/cd31cc4ee70a428d9c8242888ec0f792` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:10.049651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] RBAC: Authorizing `identity:get_project(project_id=cd31cc4ee70a428d9c8242888ec0f792)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:10.051873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:10.053709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 230/453] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:33:09 2022] GET /identity/v3/projects/cd31cc4ee70a428d9c8242888ec0f792 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:10.059486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:10.163757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ecad4-68f7-4e0a-a147-709606d2b89e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:10.199339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:10.200197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:10.200475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:10.200743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] PATH_INFO: `/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:10.201960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] RBAC: Authorizing `identity:get_group(group_id=26bc3fba919c4ce8b51bb30a4f5683b4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:10.203422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d770f-9ab3-4d6d-91c7-0b3923db7eb0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:10.205054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 224/454] 10.222.0.48 () {56 vars in 1180 bytes} [Tue Jun 28 17:33:10 2022] GET /identity/v3/groups/26bc3fba919c4ce8b51bb30a4f5683b4 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:10.212338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:10.314954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01171359-7b88-46b8-9068-f1c6922c5020 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:10.350532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:10.351195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:10.351464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:10.351739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:10.352564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] RBAC: Adding query filter params (group.id=26bc3fba919c4ce8b51bb30a4f5683b4, role.id=92f222645a174bcab24981d46e9900f9, scope.project.id=cd31cc4ee70a428d9c8242888ec0f792) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:10.352866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:10.354335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876d88d-d10c-47cb-8403-975bd0cd19e2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:10.357441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:10.361261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 231/455] 10.222.0.48 () {56 vars in 1376 bytes} [Tue Jun 28 17:33:10 2022] GET /identity/v3/role_assignments?group.id=26bc3fba919c4ce8b51bb30a4f5683b4&scope.project.id=cd31cc4ee70a428d9c8242888ec0f792&role.id=92f222645a174bcab24981d46e9900f9 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:13.209491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127c9f-e677-40ef-adac-de2f4c5a0c26 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.210105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127c9f-e677-40ef-adac-de2f4c5a0c26 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.210509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127c9f-e677-40ef-adac-de2f4c5a0c26 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.213441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 225/456] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:13.222179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688eea-ec3f-4f6b-8175-77d69430c685 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.222798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688eea-ec3f-4f6b-8175-77d69430c685 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.223119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49688eea-ec3f-4f6b-8175-77d69430c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.259147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-49688eea-ec3f-4f6b-8175-77d69430c685 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:13.261191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-49688eea-ec3f-4f6b-8175-77d69430c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:13.394694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 232/457] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:13.432756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37127c9f-e677-40ef-adac-de2f4c5a0c26 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:13.452050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:13.593927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369978f-940c-4577-bb2a-134c6b3a9d0e None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.594400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369978f-940c-4577-bb2a-134c6b3a9d0e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.594895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369978f-940c-4577-bb2a-134c6b3a9d0e None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.596483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37127c9f-e677-40ef-adac-de2f4c5a0c26 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:13.599523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 233/458] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:33:13.605641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06ebe-c884-493c-928d-4c610676f717 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.605961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06ebe-c884-493c-928d-4c610676f717 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.606225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06ebe-c884-493c-928d-4c610676f717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.641745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c2a06ebe-c884-493c-928d-4c610676f717 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:13.646647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c2a06ebe-c884-493c-928d-4c610676f717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:13.671212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:13.672669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.674833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.675382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.697991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:13.698498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7e74931d-d430-4449-9731-ccc05949d1bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:13.766179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:13.767587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:13.769392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:13.769392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:13.769392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:13.769392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:13.777411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 226/459] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:13.785259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d67ab3-f121-400f-b4f1-5139e21e1d39 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.785259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d67ab3-f121-400f-b4f1-5139e21e1d39 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.785259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d67ab3-f121-400f-b4f1-5139e21e1d39 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.787832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 227/460] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:13.789626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d67ab3-f121-400f-b4f1-5139e21e1d39 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:13.811145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 234/461] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:13.814259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:13.815133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:13.815908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:13.847094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:13.848691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:13.902904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:13.951207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:13.966955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d67ab3-f121-400f-b4f1-5139e21e1d39 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:13.973479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 235/462] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:13.974766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.017853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.018953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.018953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.019143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.020110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:14.020424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.021840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea316cf-dd53-4aec-89af-00976a1f4fa8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 228/463] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b7-e8be-4397-8469-2ac898d6c764 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b7-e8be-4397-8469-2ac898d6c764 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c9b7-e8be-4397-8469-2ac898d6c764 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 229/464] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:14.039165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c9b7-e8be-4397-8469-2ac898d6c764 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.111637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2359e-83ae-4c0b-9300-9886ec13d66e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:14.150750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.151576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.151846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.152114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.161723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c9b7-e8be-4397-8469-2ac898d6c764 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:14.163620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.165154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:14.184736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:14.185746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:14.186920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:14.186920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:14.186920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:14.186920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:14.191964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 236/465] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:14.192153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:14.192235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.209853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.210966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.211245 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.211526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.226728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.228248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.240604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-c81369cf-cb49-49f2-a0d0-5ee361646ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:14.253547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:14.255580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:14.257234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:14.257234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:14.257234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:14.257234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:14.260284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 230/466] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:14.262172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.262498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.262851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.284243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:14.285699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:14.360404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44762968-ea16-49b9-b885-aad53d1a4e69 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:14.382102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 231/467] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:14.382102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.432796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.434256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.434735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.435221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.436797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.438992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.477981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 237/468] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:14 2022] POST /identity/v3/users => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:14.477981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.620322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cb7d5-b863-4d71-92ec-6a63e2287d22 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:14.627560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:14.680952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:14.693991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7c49-fb9b-4800-ad35-e9a8e42b1c30 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:14.713108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.714574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.715212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.715794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.718317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:14.719055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.723024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.751980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 232/469] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:14.753796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.776333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:14.777455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:14.777871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:14.778346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:14.779626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:14.780139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:14.790005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:14.814508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 238/470] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:14.817435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:14.975560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e42f-73a9-4249-b443-3f9ea85b321f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:15.009331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c9cdf-c95b-4503-b26f-e42849a473b8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:15.020276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:15.021095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.021380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.021661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.022433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:15.023930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:15.053279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 239/471] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:14 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:15.054206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:15.086548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:15.100530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:15.101457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.101750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.102039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.126604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:15.131199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:15.173090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:15.175120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:15.178349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:15.178349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:15.178349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:15.178349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:15.178349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 233/472] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:15.186389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:15.239710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:15.323774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211fb3a-24c4-4b10-b624-a4bdf4faca73 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:15.372422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:15.373125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.373415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.373689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.377466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:15.378285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:15.382467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:15.383958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff671035-f6f2-4656-8b28-5f2db80316ce None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:15.413222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 234/473] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:15.422074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:15.432736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:15.433443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.433723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.434022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.434809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:15.436344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3c6c-5644-49d4-9289-ff9e6d36cc53 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:15.465381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 240/474] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:15 2022] POST /identity/v3/users => generated 249 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:15.598999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccc63-a261-486e-8215-76da32c0cd33 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.599464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccc63-a261-486e-8215-76da32c0cd33 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.599608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ccc63-a261-486e-8215-76da32c0cd33 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.601592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 241/475] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:15.608534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:15.610097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.610524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.610673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.651714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:15.654579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:15.673042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceb452-40b9-4cd5-9a5e-1a39876e749b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:15.748137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:15.749313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:15.749792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:15.750297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:15.751505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:15.754804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:15.794269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 235/476] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:15 2022] POST /identity/v3/users => generated 248 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:15.810919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:15.825177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 242/477] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:33:15.867310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:16.100386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01a13-cf00-4a6c-b4ff-f2be00302fa8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:16.167015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:16.179368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:16.180517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:16.181549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:16.182747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:16.184267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:16.186947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:16.199802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.sql.core [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 17:33:16.199802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 17:33:16.199802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [parameters: {'id': 'abaf520970e3467aa60c25172b0f1f97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 17:33:16.199802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:33:16.231858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return ref.to_dict() Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:33:16.233506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application yield resource Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise self.value Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application session.commit() Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 17:33:16.236200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.flush() Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application compat.raise_( Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 17:33:16.241312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:33:16.244665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:33:16.251481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [parameters: {'id': 'abaf520970e3467aa60c25172b0f1f97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:16.253151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 28 17:33:16.257561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:16.259576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 236/478] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Jun 28 17:33:15 2022] POST /identity/v3/roles => generated 144 bytes in 369 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:16.259706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:16.455651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14da22-9e2a-4aa6-9005-a1ac4deb51ef None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:16.528272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:16.530074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:16.530790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:16.531494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:16.554533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7d60a66a-ca92-438e-aa33-d48f2486fd64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:16.571594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:16.573567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 28 17:33:16.575479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:16.579655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 243/479] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:33:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:16.587166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:16.711056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459fca3-d357-4fb2-8bb9-281a6ba0c0f6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:16.755683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:16.756389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:16.757115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:16.757397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:16.758213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:16.758528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:16.759987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27470274-1dfe-40f1-8fdf-484794c8872c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:16.778879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 237/480] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:18.261636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5f4f-1c9e-491f-86e8-bf261e929856 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.262706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5f4f-1c9e-491f-86e8-bf261e929856 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.262706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed5f4f-1c9e-491f-86e8-bf261e929856 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.265532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 244/481] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:18.274955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887e63-2b1a-4535-9c6c-2853608db531 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.275855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887e63-2b1a-4535-9c6c-2853608db531 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.276106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887e63-2b1a-4535-9c6c-2853608db531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.320330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ad887e63-2b1a-4535-9c6c-2853608db531 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:18.322512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ad887e63-2b1a-4535-9c6c-2853608db531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:18.458365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:18.494115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 238/482] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:18.558863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5f4f-1c9e-491f-86e8-bf261e929856 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:18.579027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77c4c-e1e0-412e-b39c-1bcc164596c9 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.579523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77c4c-e1e0-412e-b39c-1bcc164596c9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.580038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77c4c-e1e0-412e-b39c-1bcc164596c9 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.583110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 239/483] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:18.589799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7927-e225-4781-8fd4-0dddf47c11c4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.590299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7927-e225-4781-8fd4-0dddf47c11c4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.590781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b7927-e225-4781-8fd4-0dddf47c11c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.634547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-920b7927-e225-4781-8fd4-0dddf47c11c4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:18.636558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-920b7927-e225-4781-8fd4-0dddf47c11c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:18.694386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:18.753233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:18.756471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4a4f-fd59-426a-a9bf-0c85d1f1252d None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.757264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4a4f-fd59-426a-a9bf-0c85d1f1252d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.758037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb4a4f-fd59-426a-a9bf-0c85d1f1252d None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.765451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 241/485] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:18.775517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.776127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.777294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.792622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed5f4f-1c9e-491f-86e8-bf261e929856 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:18.805442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:18.806977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:18.852976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:18.854325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:18.854818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:18.855301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:18.874453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:18.884620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:18.885591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:18.886408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:18.887026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 245/486] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:18.891695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:18.905995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 242/487] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:18.906949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:18.978455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.045308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e68f33-634c-4b60-ae7d-a8b6ff47cc36 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.055082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24dfbd-2e8e-4581-95ac-a9f77c9325dd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.078357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.095154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.096240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.096614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.097040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.104391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.105864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.106524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.107018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.108073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:19.108736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.110293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:19.111022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:19.119327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:19.120563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:19.121804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:19.127290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 243/488] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:19.129289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.130396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:19.134024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.244693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e831d4d-9075-43da-9057-db90426bd2a8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.282559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.283392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.283845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.284196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.285147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:19.286347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.287102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.301785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 247/490] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:19.302943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.309562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5d71-c0db-404d-95ac-7ce043f4de52 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.328455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.354770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.376048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.377214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.377741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.378400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.400028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:19.415104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:19.416217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:19.417102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:19.422188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0128-4e56-446b-9abc-aa6c257dcf18 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.427259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 244/491] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:19.429017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.461391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.462749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.463249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.463707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.476824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.478770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:19.498240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:19.499179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:19.500057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:19.500057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:19.500057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:19.500057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:19.501669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 248/492] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:19.502745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.585782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d52e24-4592-4421-a45c-e450b9630818 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.631980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.632730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.633014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.633293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.646637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.648172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.664089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:19.670894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:19.671890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:19.672699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:19.672699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:19.672699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:19.672699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:19.672699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 245/493] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:19.674050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.681357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22b794-92a3-4f35-b529-b5fa4a2b5451 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.714669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:19.721440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.722265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.722610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.722890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.723662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:19.723975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.725386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb683a5e-5076-46e9-8230-6c1a1b9db80f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 249/494] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd59f-821a-459e-befd-0e002c5604fb None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd59f-821a-459e-befd-0e002c5604fb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bd59f-821a-459e-befd-0e002c5604fb None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 250/495] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:19.743744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd59f-821a-459e-befd-0e002c5604fb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:19.850605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f36e1-d8ed-4ade-bad7-23cf6105d7e5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.881832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bd59f-821a-459e-befd-0e002c5604fb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:19.912057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.913196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.913690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.914212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.915596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:19.916129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.918537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72528de2-7ce7-4fe0-a2b8-fbd99b980bf9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.941372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 246/496] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:19.944463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.944920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.945401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.948931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:19.950164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:19.950888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:19.951427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:19.952788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:19.953416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:19.956077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:19.972039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:19.974320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:19.984122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 251/497] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:19.984122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.009198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.077921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 247/498] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:20.079631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.105068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.114066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82bad0-da81-4ecb-9798-76f42981702f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.151530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.152345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.152626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.152902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.164547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.166001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:20.185024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:20.186136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:20.187161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:20.187161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:20.187161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:20.187161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:20.187161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 252/499] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:20.187431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.221009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b26c5d-4d45-4153-93d6-1b66e0c5f6fc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.257322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.264688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.266123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.266668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.267108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.281850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.284680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.292852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae2fcf-a026-46d7-8e71-7029e98ab3ce None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-6b6672b9-42dc-4eb2-8514-0c6b5a5705f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:20.314103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:20.320443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 248/500] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363d81-b725-476e-b90a-654e9e3eaa9f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.321342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363d81-b725-476e-b90a-654e9e3eaa9f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.322032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c363d81-b725-476e-b90a-654e9e3eaa9f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.322032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 249/501] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:20.322032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c363d81-b725-476e-b90a-654e9e3eaa9f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.337579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.338440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.338713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.338989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.347063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.349314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:20.367020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:20.367989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:20.368854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 253/502] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:20.369958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.435898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.476871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c363d81-b725-476e-b90a-654e9e3eaa9f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.509829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96737bb-47d9-46ff-8fd8-8aece08c0366 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.528578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.529897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.530419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.530892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.538372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.546799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:20.547005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.547556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.547832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.548089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.549172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:20.549468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.550955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aeab7-ca85-40e4-99d8-9e3428e971d2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:20.555430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:20.556354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:20.557119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 250/503] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:20.558117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.565311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 254/504] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:20.567453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.567738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.568017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.585137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:20.586427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:20.661181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 255/505] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:20.662086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.694626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6b79-81a2-4bfd-be81-55eceb4e2a1e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.732300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.739350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.740055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.740335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.740620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.741484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:20.741797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.743340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.792822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d2e2-29c3-4c7c-9b49-af590eb8b7d5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.814698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:20.823721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:20.823721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.837784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.838533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.838807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.839087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:20.839985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:20.840292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:20.841804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:20.885729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 256/507] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:20.886639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:20.950024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39813f2-73b6-4d6e-93d2-ce3ca1dfc271 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:20.998336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:20.999193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:20.999595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:20.999952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.000813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:21.001201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.002820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.012832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:21.013683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.018786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebe66f-831a-4c9c-a6db-8b6c1c5af7d5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.060805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.061776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.062144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.062604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] PATH_INFO: `/v3/users/glance` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.072198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.073802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.075088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:21.093465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:21.095155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 257/509] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:21.096891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.135264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8641-61bd-432f-ac16-e01a52954fbb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.161321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.179722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.181409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.181890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.182399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.202233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.205002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.236334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d438-c7f4-4fdd-ac51-220fcd50ecfa None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:21.237817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:21.240082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 253/510] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:21.241876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.280565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.281489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.281865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.282255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.360079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.361563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.380554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125c85-dab3-4bce-8ba3-aad00dbb7225 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.383538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.404322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.420320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.420998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.421260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.422117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.496792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 258/511] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:21.498372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.505101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.506804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.624206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d5ac2-1f61-4511-a184-31ff1910cad1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.628184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 254/512] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:21.629109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.635475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.673037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.674435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.674791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.675126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.678847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.689299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.690898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:21.710102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:21.711638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 259/513] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:21.713203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.789816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae426e6-4ec6-4769-9e23-0bb5fcbd8489 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.828735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.829423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.829704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.830005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.830873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:21.831188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.832714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.843691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db42d4-1566-4168-97b2-b8134635b66e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:21.852284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 255/514] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:21.853143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.879651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:21.880068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:21.880340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:21.880614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:21.881333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:21.881633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:21.883076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:21.897545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 260/515] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:21.898610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:21.942948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.956216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:21.988104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275477d-0380-46ea-982d-93fcc921636e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.015391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb3a78-adf1-485d-a415-4e459e5de488 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.024815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.025540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.025812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.026118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.037290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.038835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.053301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.054146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.054426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.054701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:22.057920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:22.058949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:22.059992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:22.059992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:22.059992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:22.059992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:22.063893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 256/516] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:22.064846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.072595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.075403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:22.108374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:22.109370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:22.110247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:22.110247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:22.110247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:22.110247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:22.110664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 261/517] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:22.114917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.190479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e9e34-6b55-43ea-86c9-854fc2e64f4b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.209771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.233960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.234687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.234968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.235243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.235989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:22.236293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.237756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.249879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.252348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 257/518] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:22.253228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.255377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb702a-1a08-4995-8163-0e2ad7359c64 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.309724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.310499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.310879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.311247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.384758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd713c5-95de-4294-b162-8c18a64aaa9e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.404088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.406637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.429641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.430650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.431025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.431383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.432346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.434198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.458534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 258/519] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:22 2022] POST /identity/v3/users => generated 247 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:22.459784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.514715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.552459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.562840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 262/520] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:22.564417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.636853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7792-578e-406b-b316-852fd7a2a110 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.696222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.697272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.697708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.698185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.699176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:22.699543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.701928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.724688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 259/521] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:22.725599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.743183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a257e8-4571-4e6b-adbb-be1292a9c988 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.807375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.808552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.809053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.809549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.810971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:22.811516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.814269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.836076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 263/522] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:22.837580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:22.874199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.890192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf49f-7c7b-445e-a544-6830abcf7bcc None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:22.935401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:22.955729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:22.957155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:22.957624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:22.958134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:22.972110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:22.975267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:22.987126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ea954-eb3f-4f39-b8fc-80948dac17c1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:23.004630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:23.005770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:23.006979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 260/523] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:23.008904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.034126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.034978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.035259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.035518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.049933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.051680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:23.071626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:23.073196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:23.075593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:23.075593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:23.075593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:23.075593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:23.077516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 264/524] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:23.078560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.188799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091bbea-f1fe-4aea-a460-7e27fa849025 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.214825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e68f6-5280-44a1-a052-6ad76d2b3957 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.232189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:23.240725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.242348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.242816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.243343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.252730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.255826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.258774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.259611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.259902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.261650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.272802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:23.274040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:23.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:23.282207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 261/525] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:23.283191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.283320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.296181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:23.300203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:23.303201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 265/526] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:23.304815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.447300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a912031-f919-4aba-bfcc-a9a2ca5a7f2d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.473551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da52e6-07f2-4d84-8d53-1beb9e46c66b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.507895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.509087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.509598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.510138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.511862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:23.512421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.515399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.539989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.541439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.542110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.542735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.544336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:23.544998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.547903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.560576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 262/527] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:23.560576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.573817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 266/528] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:23.573817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.648654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:23.659697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:23.713365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f1f4f-13b1-478c-a71d-894ae7ef9534 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.783905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493580f-76fd-4391-ae55-84ff9e800657 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:23.785504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.786409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.786887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.787316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.788306 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:23.788874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.790879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.812561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 263/529] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:23.814016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.844950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:23.846167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:23.846717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:23.847373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:23.849828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:23.850493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:23.853235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:23.890104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 267/530] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:23.891131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:23.982289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219b78d-f678-43ab-a405-0445e5288ef7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.035274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:24.049078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:24.050851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.053624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.053624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.053624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.062201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4c8ea-fd7e-424a-b184-732bfd016576 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.121895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.122954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.123393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.123833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.136563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.138828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:24.163349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:24.164924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 268/531] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:24.167098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:24.194095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.197610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:24.292039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5b9d1-1f1d-4c60-90ca-4720b0bf376c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.344094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.345064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.345515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.345977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.347452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:24.351427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.353169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:24.363365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 269/532] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:24 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:24.365501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:24.404675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:24.412604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 264/533] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:24.415622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:24.487703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:24.583149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca785f-0e6e-4115-bd1d-0e68a44cdb1b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.652743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc7773-a237-4b83-b62c-1b11ce97eed2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.656882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.658479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.659282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.660079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.661989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=51413215fe6d42f7a76a6764c2a993cb) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:24.662949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.666072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:24.679446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 270/534] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:24 2022] GET /identity/v3/role_assignments?user.id=51413215fe6d42f7a76a6764c2a993cb&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:24.684193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:24.767523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.768234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.768515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.768789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.769649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:24.770116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.771651 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:24.808747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 265/535] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:24.818778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:24.913423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:24.939260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5268-341e-45fc-998a-32203dff45e6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:24.977115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:24.977956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:24.978247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:24.978522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:24.991500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:24.993097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a31d7a2d-6820-4daa-86c4-d2bc4d4cd3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:25.012978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:25.013861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:25.015248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:25.015248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:25.015248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:25.015248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:25.015248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 271/536] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:25.015942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa5eb5-c91a-46e8-ab17-e1e3ffa617a4 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.016227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa5eb5-c91a-46e8-ab17-e1e3ffa617a4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.016513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa5eb5-c91a-46e8-ab17-e1e3ffa617a4 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.026496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 272/537] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:25.026496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa5eb5-c91a-46e8-ab17-e1e3ffa617a4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.051852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111215f-cd88-4480-b4c0-db4004f0b30c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:25.063023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:25.102749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:25.103596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.104003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.104379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.105323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=7d734accab24459a8a6848029c1f6315) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:25.105738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:25.107391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befc621-dfeb-49c9-91ea-59a5722d6bc0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:25.114577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 266/538] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:24 2022] GET /identity/v3/role_assignments?user.id=7d734accab24459a8a6848029c1f6315&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:25.115763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.116191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.116565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.136900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:25.138383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:25.169427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa5eb5-c91a-46e8-ab17-e1e3ffa617a4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:25.237850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:25.249291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:25.250024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.250309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.250585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.251339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:25.251651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:25.253144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:25.268120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 267/539] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:25.289484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 273/540] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:25.295198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.296325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.407635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:25.437082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a0d7d-e6a5-44f3-9488-d11032a54baf None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:25.482035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:25.482885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.483163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.483437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.493360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:25.494894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:25.511450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:25.512790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:25.515063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 268/541] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:25.527076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.564652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c76a-8a39-4986-ad19-c1b078f1f057 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:25.645018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:25.646415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.646872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.647355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.682859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:25.712203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:25.713246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:25.714091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 274/542] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:25.721367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.807316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aff8f2-d3b2-4401-abeb-ba7832d39cd9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:25.847044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:25.874742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:25.875716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:25.876365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:25.877704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:25.879176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:25.880820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:25.882670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:25.912611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 269/543] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:25.916440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:25.920657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:25.953681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b044a-11a5-4c59-b6f6-dbe2d7927736 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:26.036702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:26.037771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:26.038278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:26.038748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:26.039706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:26.040238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:26.041845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:26.049979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce27f92-4c82-4f2c-8e90-155e5c9b03de None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:26.061760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 275/544] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:26.068016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:26.087080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:26.087767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:26.088049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:26.088326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:26.091294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=5fabfc6086e244db994a4bbbbbdfc5b7) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:26.091294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:26.091294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:26.098650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 270/545] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:25 2022] GET /identity/v3/role_assignments?user.id=5fabfc6086e244db994a4bbbbbdfc5b7&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:26.241356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48961d5d-bc00-4a05-82cd-13c30695ff73 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:26.265424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:26.290835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:26.292753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:26.293508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:26.294418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:26.313192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:26.315944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:26.359631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:26.361209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:26.367457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:26.367457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:26.367457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:26.367457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:26.370849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 276/546] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:26.376720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:26.478322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:26.537529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c28c6-6a18-46cb-b057-0bc9e8ef4b71 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:26.584948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:26.585549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:26.585823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:26.586125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:26.586917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:26.587228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:26.588639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:26.604460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 271/547] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:26.609750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:26.755536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0b458-6e83-449f-a3f3-897eca44d0c8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:26.820734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:26.821574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:26.821854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:26.822153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:26.835372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:26.836805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:26.856179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:26.857650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:26.859186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 277/548] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:26.863930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:27.016237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f60335-b105-44a1-9cfb-b91cd493cf29 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:27.056897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:27.068850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:27.070406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.071042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.071770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.072659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:27.072975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:27.074526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae80510-dcd9-4f67-9f29-13ab82fde3b4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:27.108636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 272/549] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:33:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:27.129125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:27.173392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:27.275741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62262cdb-6a85-469a-94c7-54db1514f28c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:27.329512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:27.330230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.330507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.330778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.370698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cd81-29db-4e8f-89e6-0118648da34e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.370874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cd81-29db-4e8f-89e6-0118648da34e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.371158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cd81-29db-4e8f-89e6-0118648da34e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.372828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 273/550] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:33:27.381514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.381861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.382189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.427807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:27.429165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:27.431818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:27.433707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:27.490078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:27.634044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 274/551] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:27.648523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 278/552] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:33:27.653714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:27.669047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:27.842189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2feee-e86a-43d9-a7a9-2c7804e00d3b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:27.881408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:27.901608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:27.903485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.904101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.904907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.915958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fe1bb-48d6-4cfd-8bb9-3bd8baee2535 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:27.923945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:27.937630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a0945f46-05be-4d23-940c-2410392bc7d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:27.945010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:27.946532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:27.947610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:27.950030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 279/553] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:27.952359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3dd0-9c25-4adb-900e-d630667b1f63 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.952862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3dd0-9c25-4adb-900e-d630667b1f63 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.953494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e3dd0-9c25-4adb-900e-d630667b1f63 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:27.957458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 280/554] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:27.958339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e3dd0-9c25-4adb-900e-d630667b1f63 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:27.984101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:27.985428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:27.985913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:27.986444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.006922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.008420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-27c7213d-f53b-4ca4-98fe-1d5313672374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:28.027281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:28.028492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:28.029614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:28.029614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:28.029614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:28.029614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:28.029614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 275/555] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:28.029875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33e10-03b9-4065-9e49-1bd4c1ebf33a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.030490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33e10-03b9-4065-9e49-1bd4c1ebf33a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.030490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33e10-03b9-4065-9e49-1bd4c1ebf33a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.032118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 276/556] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:28.033309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.033614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.033851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.063741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:28.065594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:28.143321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e3dd0-9c25-4adb-900e-d630667b1f63 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.168270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 277/557] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:28.169313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.205766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.206960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.208105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.208662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.210411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:28.211128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.213102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ee4b3-4284-4062-8180-e8fef63c3105 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.228842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 281/558] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:28.230373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.230679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.230958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.249601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:28.250915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:28.311256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.322456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.330190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390b4a4-57b9-4eff-81f3-5fb4b2e63ec2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.340652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 282/559] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:28.341636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.388783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.389934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.390483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.390977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.392423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:28.392970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.395457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.416234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 278/560] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:28.417567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.505387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73908337-c5d4-47d0-b84e-51034e0ac0fe None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.557052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592405a-078a-44a7-9688-9deaa459b7ce None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.557896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.558941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.559315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.559702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.572158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:28.580131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:28.581173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:28.582179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 283/561] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:28.582861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.606529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.607347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.607648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.607897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.620246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.621748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.633789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:28.644999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:28.647781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 279/562] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:28.649775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.666417 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.724816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b1a92-e718-48fd-ad6b-21c75a8eed79 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.773932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841c926-d52b-43e6-a87c-f52e067f92f8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.776166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.777034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.777321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.777568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.792293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6b782f9c-d2ba-44c4-ab2c-df7f54ff6227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:28.808678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:28.810312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:28.811491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 284/563] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:28.813269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5198-4abe-43ed-afb7-74ceb14b18eb None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.813767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5198-4abe-43ed-afb7-74ceb14b18eb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.814289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e5198-4abe-43ed-afb7-74ceb14b18eb None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.817986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 285/564] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:28.818913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5198-4abe-43ed-afb7-74ceb14b18eb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.828010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.829295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.829702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.830114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.838780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.840267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:28.855726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:28.857025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 280/565] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:28.858125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:28.939330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.946195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e5198-4abe-43ed-afb7-74ceb14b18eb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:28.951141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:28.988188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:28.989137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:28.989469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:28.989811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:28.990747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:28.991194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:28.992920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:28.993436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee505a1-15ca-4e78-95d0-1decfcfa97b2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.003382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 286/566] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.004727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.046081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.046677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.046956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.047234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.047990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:29.048295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.050149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2607a00-3e44-45a0-aecd-68a71bc721d3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.066088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 281/567] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.069740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.070221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.070762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.090510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:29.091751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:29.117926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0907ec-4be1-4030-8176-1303dd74d774 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.158069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.158952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.159341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.159802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.160616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:29.160920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.162792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.168237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 282/568] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:29.169119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.185989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 287/569] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.185989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.215473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.246078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.293125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60267-5d42-4c97-ae64-c738e56d14da None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.309080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c520e-98f1-479b-8f10-878f8e402e21 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.335104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.336616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.336616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.336616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.337090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:29.337399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.338920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.351230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 283/570] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.352177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.356615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.357438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.357722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.358032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.369845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.371350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:29.389179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:29.390171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:29.391038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:29.391038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:29.391038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:29.391038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:29.391038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 288/571] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:29.391310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.463753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f50c54-1b61-4e49-b4b6-849b9341e005 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.482265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.485128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.507787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.509069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.509522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.510043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.512253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3546599-c474-4cab-be86-8dbda178bcfd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.521175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.522715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:29.540622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:29.542142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 284/572] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:29.543462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.555803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.556841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.557130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.557408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.580113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.581535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:29.600900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:29.602534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 289/573] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:29.603602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.665448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2bf1-676e-4897-b217-deb2fa601ab7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.704300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.705118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.705397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.705669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.718002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:29.720246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e381426-409c-4b47-959e-e6d66a97e8e9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:29.726612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:29.727594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:29.728397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 285/574] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:29.729069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.749113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.763597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.765029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.765599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.765765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.767413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=dc6c5d2d92294b1396bd6ca40db346bd) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:29.768004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.770747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.773228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:29.779701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 290/575] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/role_assignments?user.id=dc6c5d2d92294b1396bd6ca40db346bd&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.780553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.862204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533152d5-613e-4570-aaed-1c4346ba3e0c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:29.917196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:29.917921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:29.918274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:29.918524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:29.919323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:29.919640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:29.921176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:29.942896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 286/576] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:29.942896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:29.961895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dce1af-abc8-4996-a105-56fbd8ee1320 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.013232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.014057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.014422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.014765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.015700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:30.016078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.017638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.045377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 291/577] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:30.045377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.076458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.083785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d08d6-82b7-4dab-a5be-075c37da08b9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.133405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.134092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.134316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.134569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.135304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:30.135608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.136802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.137056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.157490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 287/578] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:30.157490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.228789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ddac-2be6-4435-94ad-dc99b8ea2046 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.288309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.289078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.289368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.289650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.290628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:30.291011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.292924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.304453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 292/579] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:30.305325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.319222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6127d-5d4b-484c-aaf3-205100e04374 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.378533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.380079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.380359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.380644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.390595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.391961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:30.409328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:30.411011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 288/580] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:30.412629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.440057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96392600-75c2-4fa5-ad9c-9abc36ad49f7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.440326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.453450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.488821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.489844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.490178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.490484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.506530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.508711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:30.540106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:30.541062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:30.541911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:30.541911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:30.541911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:30.541911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:30.542358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 293/581] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:30.544394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.554811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6aceb-0ae5-472c-bb21-5f462e0b617e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.593118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.593977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.594360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.594646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.603611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.605072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:30.620766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:30.622051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 289/582] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:30.623213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.708650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96cc83-f85f-48e2-b2b5-2b441b826e19 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.749243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.750098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.750636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.751152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.751152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.766852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.771342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.787696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a316-8c94-4124-be26-c257ff308a4a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:30.799733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:30.801033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:30.802392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:30.802392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:30.802392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:30.802392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:30.802392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 294/583] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:30.803665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.824345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:30.841187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:30.841880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:30.842196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:30.842478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:30.843328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:30.843643 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:30.845118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:30.872787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 290/584] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:30.872787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:30.959693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f7e5-b42c-423c-87a0-c72cd22bd271 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.014636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159d815-35ef-4558-8c1c-547cb3c7ae5d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.028033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.028741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.029022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.029285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.030058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:31.030371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.031769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.046336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 295/585] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:31.047655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.069803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.071006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.071525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.071981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.073627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:31.074209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.076978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.082399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.112564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 291/586] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Jun 28 17:33:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:31.115009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.155843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.195592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8ae9-4297-4189-a524-436444414265 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.236512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.237084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.237369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.237643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.238680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:31.238996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.240535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.253574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 296/587] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:31.254532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.275158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba203-f0ba-4cf6-a49c-ed8af2fe0b7d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.326215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.327034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.327312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.327589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.344850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.346690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:31.368046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:31.369794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 292/588] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:31.372902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.421107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855dc76-a19e-4574-b0d4-60d2d2e96d38 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.436189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.482650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.483677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.484079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.484483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.487469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.496693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.499236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:31.518902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:31.520792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:31.523486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 297/589] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:31.525215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.546782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1c27c-c6db-4aac-b1a5-7299aa36b884 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.611803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.614223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.614983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.615451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.635405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.637758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:31.670084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:31.671701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 293/590] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:31.675093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.692219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6de6-272f-4bf8-9375-1a155844c086 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.733043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.733867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.734181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.734473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.743704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.745079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:31.771348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:31.773066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:31.774953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:31.779647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 298/591] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:31.781167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.855449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.862019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c79083-8213-4591-9167-b5330c4d15e4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:31.887756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:31.927002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:31.928134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:31.928604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:31.929091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:31.930532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:31.931058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:31.933671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:31.952887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 294/592] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:31.953770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:31.969057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc4af-0832-46fb-a53c-319089a8be25 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.030402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.031415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.031903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.032398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.033865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:32.034432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.037433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.057622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 299/593] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:32.058766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.072728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e782514-53e5-453d-befc-0be8e51c231d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.113276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.114665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.114992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.115231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.115959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:32.116260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.117684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68dfc0-8dc4-4579-88ef-006d9d5efb5b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.131072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 295/594] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:32.132458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346ebb-ad0a-428d-bca9-e3de2269671b None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.132745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346ebb-ad0a-428d-bca9-e3de2269671b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.133017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346ebb-ad0a-428d-bca9-e3de2269671b None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.134364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 296/595] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:32.135115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346ebb-ad0a-428d-bca9-e3de2269671b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.155893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:32.187254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92939b13-0d0e-42d1-9ed6-2aff06435907 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.203189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:32.226448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.227128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.227400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.227671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.228526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:32.228829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.230308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.250694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:32.251532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.274981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346ebb-ad0a-428d-bca9-e3de2269671b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.332249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.333058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.333509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.333894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.345371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.347922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:32.367653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:32.369082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:32.371105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:32.373911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 297/597] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:32.374694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.405148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1fa1-85ac-4486-81d3-93934071f659 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.449216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.450762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.451241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.451694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.464032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:32.476973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=ef1eedbaa7574783adde2884c2b9a482, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.479392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b080e4-605d-4c5a-a2e6-0ec3aba04008 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.489144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fdf92-805d-4849-b61c-616cb3d4fcde None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.496903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 301/598] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:32 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:32.498511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.498912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.499327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.525108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:32.526496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:32.546493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.547792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.548213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.548979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.551781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:32.563288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.565912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:32.594428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:32.596224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:32.598201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:32.599024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 298/599] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:32.600379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.641425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 302/600] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:32.642994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.800258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c80567-a5e7-4ff6-bc57-0d3d9c3fe348 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.842754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d351f8-de8d-4d59-828a-2f006e593e85 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:32.849123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.850892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.851564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.852198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.865265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:32.873621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.876218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.902231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:32.903150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:32.903555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:32.903957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:32.905038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:32.905490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:32.907240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:32.912221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:32.914420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:32.916190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:32.916190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:32.916190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:32.916190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:32.919019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 299/601] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:32.919650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.934593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 303/602] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:32.936431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:32.965359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:33.092838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555235-0623-41a8-b3b6-c561d4b60eda None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.105311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a2b15-1899-4912-960e-3e99387999d2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.147660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.148349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.148635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.148913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.149714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:33.150059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:33.151541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:33.154447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.155813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.156308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.156791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.168079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 300/603] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:33.169453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:33.172319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:33.182466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:33.184471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:33.186288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:33.187908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 304/604] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:33.194032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:33.255062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:33.300282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:33.340271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d9707-c158-40a9-bcbc-65168e95393f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.340853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ddf31-f2ec-4b76-9f78-a70ace15ffac None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.379805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.380666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.380944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.381222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/7d734accab24459a8a6848029c1f6315/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.398955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.399647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.400039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.400208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.400947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:33.401255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:33.402701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:33.403358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=7d734accab24459a8a6848029c1f6315, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:33.406097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:33.416982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 301/605] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:33.422618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:33.432472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 305/606] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:33 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/7d734accab24459a8a6848029c1f6315/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:33.433777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:33.622285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723147ce-a390-4bd6-8fac-fa79491181f6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.638925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915c4cb-5ec8-478d-875f-062bab00643c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:33.639795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:33.683007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.684056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.684419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.684771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/51413215fe6d42f7a76a6764c2a993cb/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.701179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:33.714878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=51413215fe6d42f7a76a6764c2a993cb, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:33.717516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:33.728247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:33.730319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:33.730875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:33.731633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:33.733813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:33.734551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:33.739312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:33.748888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 302/607] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:33 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/51413215fe6d42f7a76a6764c2a993cb/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:33.750692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:33.766178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 306/608] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:33.771591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.038924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb665-7ed7-42b9-8623-ffae41dc9c20 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:34.045926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abda147-27d8-4db9-9b8f-49577e2d73c0 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:34.108157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:34.109511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:34.110081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:34.110477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:34.117908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:34.119342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:34.119824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:34.120294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:34.143794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:34.150841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:34.157433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:34.160708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:34.188294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:34.191809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:34.195309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 303/609] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:34.204685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:34.207588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:34.210819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:34.210819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:34.210819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:34.210819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:34.210819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 307/610] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:34.225259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.225664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.295457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:34.353846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:34.519651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5cfe5-5684-4802-b9ba-6cf6e7e96aed None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:34.549993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36739280-22bd-4de8-a04c-23ba160f36d8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:34.599812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:34.600974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:34.601425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:34.601911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:34.603160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:34.603665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:34.607103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:34.643800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 308/611] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:34.650477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.715098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:34.716183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:34.716636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:34.717086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:34.718532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:34.719068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:34.721611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:34.769844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 304/612] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 547 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:34.777100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.842467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:34.855106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275721-ea7c-48c8-81bc-0cd85536beb4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:34.933095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:34.933956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:34.934249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:34.934524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:34.950313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:34.951810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:34.978368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:34.979388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:34.980287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 309/613] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:34.994887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:34.999084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:35.043043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea064d5-298a-4399-8d00-b31b35661067 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:35.102875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:35.104790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.105299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.105791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/5fabfc6086e244db994a4bbbbbdfc5b7/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.136776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=5fabfc6086e244db994a4bbbbbdfc5b7, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:35.138816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab25d6-ba2c-4b68-b90a-ec343d772e93 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:35.178200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 305/614] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:34 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/5fabfc6086e244db994a4bbbbbdfc5b7/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:35.179948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8507-c85a-45e1-b4b8-c5514758ec17 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.180243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8507-c85a-45e1-b4b8-c5514758ec17 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.180522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e8507-c85a-45e1-b4b8-c5514758ec17 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.182366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 306/615] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:35.193831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.194254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.194582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.247169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:35.249437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:35.252726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5ac67-ca84-431b-b3da-859675eb4eae None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:35.359311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:35.360390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.360858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.361298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.362966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:35.363440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:35.366087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:35.402231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 307/616] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:35.426972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 310/617] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:33:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:35.435451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:35.448206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:35.483728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:35.564816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:35.657628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb929c-4836-40ee-a4ff-d8a567e252a9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:35.743225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:35.744639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.745139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.745639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.756996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3408d-8894-4e63-b408-145967988110 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:35.791676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:35.794538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:35.829807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:35.830839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:35.831896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:35.831896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:35.831896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:35.831896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:35.832681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 308/618] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:35.843711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:35.857518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce441-287f-4711-9816-3e3338531855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:35.858762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce441-287f-4711-9816-3e3338531855 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:35.859251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce441-287f-4711-9816-3e3338531855 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:35.859909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce441-287f-4711-9816-3e3338531855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:35.881585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce441-287f-4711-9816-3e3338531855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-66dce441-287f-4711-9816-3e3338531855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:35.891267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:35.892373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:35.893193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:35.903526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 311/619] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:35.912377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce441-287f-4711-9816-3e3338531855 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:36.126592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bb216-fe00-47c4-b51e-0cc850a84235 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:36.152477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:36.182459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:36.198504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce441-287f-4711-9816-3e3338531855 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:36.204582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:36.206208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.207429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.209495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.211389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:36.212471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:36.215459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:36.268488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 309/620] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:36.274740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:36.335612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:36.339667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.340782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.343815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.345663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:36.346666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:36.349894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:36.391604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 312/621] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:36.403456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:36.626619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910704b-ceb0-492b-9f96-e41e6c4aab2f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:36.645598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e3a21-288a-446c-b6d0-4696f147fc9b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:36.711268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:36.712946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.713453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.713992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.716765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:36.718601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.719394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.720131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.727488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:36.732921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:36.735930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:36.748321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:36.751418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-ce6d42fe-4e20-42f4-91e1-b8f8d57a2e60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:36.779533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:36.781282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:36.783908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 310/622] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 508 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:36.784967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2f7c-5a7b-44a2-a88b-1005d2d73115 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.784967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2f7c-5a7b-44a2-a88b-1005d2d73115 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.785714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2f7c-5a7b-44a2-a88b-1005d2d73115 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.795450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 311/623] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:36.797420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb2f7c-5a7b-44a2-a88b-1005d2d73115 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d30ae8cf-67ca-4f63-81c3-140086e013aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:36.812666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:36.815874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:36.817678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:36.817678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:36.817678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:36.817678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:36.828821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 313/624] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:36.828821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.829429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.830015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.864691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:36.867403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:36.870557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:36.954352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb2f7c-5a7b-44a2-a88b-1005d2d73115 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:36.996316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:36.997504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:36.997504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:36.997970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:36.999009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:36.999423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:37.001183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:37.012587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 314/625] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:37.014553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.016077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 312/626] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:37.022357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.198526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:37.200246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a4ee3-c878-4c11-be06-5c3ca392d0a5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.215569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f54c2c-bfeb-4457-bf02-af26b0f670f4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.234863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:37.266368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:37.267344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.267780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.268149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.269271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:37.270620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:37.273172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:37.277848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:37.279562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.280060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.280555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/dc6c5d2d92294b1396bd6ca40db346bd/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.299052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 315/627] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:37.299052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.312694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=dc6c5d2d92294b1396bd6ca40db346bd, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:37.315535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98911-0c0c-4dd3-9bb7-738b520b7de7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:37.337206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 313/628] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:37 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/dc6c5d2d92294b1396bd6ca40db346bd/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:37.339666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71524bb-39ee-488a-8a5c-01fec5b2ea7f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.340102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71524bb-39ee-488a-8a5c-01fec5b2ea7f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.340516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71524bb-39ee-488a-8a5c-01fec5b2ea7f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.350248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 314/629] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:37.350248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71524bb-39ee-488a-8a5c-01fec5b2ea7f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.540133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c51e-a8e2-4a83-bebc-fefe92bf1225 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.568611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71524bb-39ee-488a-8a5c-01fec5b2ea7f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.611712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:37.612691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.613213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.613429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:37.613826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.614898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.615405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.615974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.623772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:37.625449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:37.638897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-86e973fc-ecab-45a0-873a-2fa4c28c3b3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:37.643341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:37.645513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:37.648060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 315/630] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:37.650015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.650015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.650015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.655564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:37.656155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:37.658309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:37.660969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 316/631] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:37.670268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.677994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:37.677994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:37.735949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:37.795671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 316/632] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:37.797532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:37.888448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4a252-33a4-4d42-b4cc-498e8f9bd0ef None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.956989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:37.958178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:37.958672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:37.959152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:37.960767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:37.961464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:37.964208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:37.982876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9208ac-6906-43e2-a3d7-dea6607da85b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:37.999001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 317/633] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:38.000612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.035616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.046566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.047681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.048128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.048978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.050297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:38.050896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:38.053429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e39496-39e3-4157-b0f4-5a0a47e3d977 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 317/634] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62fff-6b1e-4956-9720-e0cb87fab6fd None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62fff-6b1e-4956-9720-e0cb87fab6fd None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62fff-6b1e-4956-9720-e0cb87fab6fd None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 318/635] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:38.074181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a62fff-6b1e-4956-9720-e0cb87fab6fd None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.156793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.168191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b9463-8cc2-4533-abf5-9a4b50ca2cf2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:38.232988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.235000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.235527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.236272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.240253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a62fff-6b1e-4956-9720-e0cb87fab6fd None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:38.257989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:38.272236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:38.274091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:38.275691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:38.278049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 318/636] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:38.278049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.311772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.312543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.313010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.313361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.390888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.400933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:38.402464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38debe-77a5-4d90-959a-77675460be80 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:38.455954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0fe42-6343-4849-90dd-2bfab90c2c38 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:38.515346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.516754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.517262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.517725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.538716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:38.541287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:38.560062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 319/637] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:38.563418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.564270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.565035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:38.566919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:38.569301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 319/638] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:38.571601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.586975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.603422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:38.605587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:38.729658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 320/639] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:38.731040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.752869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b8571-3878-4a9e-b05d-f6197d9cc04a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:38.796666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.797455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.797768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.798167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.799350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:38.799640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:38.801223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:38.810659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.821114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 320/640] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:38.821114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:38.935314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:38.949840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6cae9-25dd-415b-98f9-a077a27d4ef8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:38.993561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:38.994705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:38.995115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:38.995519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:38.997680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae95073-dc9e-48bc-9cab-cfa1ca4b148a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.009393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.011192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:39.033459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:39.035448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:39.038165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:39.038165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:39.038165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:39.038165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:39.041888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 321/641] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:39.043167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.066254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.067144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.067534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.067906 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.068788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:39.069190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.070958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.086527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 321/642] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:39.087963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.164118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:39.215080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f85e-be4f-4ff7-b18f-fa393bcc4f6c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.278004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2ec5d-c7b6-4464-be21-fca95dfe20c7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.284200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.286475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.286981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.287472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.309146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:39.319879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:39.325305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:39.327259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 322/643] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:39.329910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.334622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.336086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.336344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.336722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.350190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.351704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:39.372144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:39.373852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:39.376045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:39.376045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:39.376045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:39.376045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:39.378092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 322/644] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:39.378964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.513298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7a3cd-b496-4d34-a2ba-9fd29290321d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.566904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948b27f-4acf-4d01-b051-9edc7accfb95 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.576308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.577526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.578077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.578597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.579929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:39.580496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.584352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.588701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:39.606524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 323/645] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:39.607416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.626256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.627087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.627362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.627638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.636192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.637684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:39.657261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:39.658305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 28 17:33:39.659237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:39.662172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:39.664129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.746441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:39.765594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee6c6b-1d86-46c5-baf7-715a0a51e4ae None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.805821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.806694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.806989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.807267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.808039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:39.808350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.809757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25e7f8-3050-4e10-93d7-9aeb7261001b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.820015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 324/647] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:39.821391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422a77a-30ec-4750-b4ec-274b7c58e1ca None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.821673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422a77a-30ec-4750-b4ec-274b7c58e1ca None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.821974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422a77a-30ec-4750-b4ec-274b7c58e1ca None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.823289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 325/648] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:39.823998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422a77a-30ec-4750-b4ec-274b7c58e1ca None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.848400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc7309-2f98-46fd-b549-590dde0c0f31 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:39.889438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:39.890141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:39.890423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:39.890701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:39.891430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:39.891726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:39.893126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:39.905859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:39.911252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 324/649] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:39.911252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:39.970237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422a77a-30ec-4750-b4ec-274b7c58e1ca None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.009093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.009912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.010222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.010491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.018085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.019630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:40.035465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:40.036545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:40.037390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 326/650] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:40.037865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.049076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e515-011e-4c82-a364-9fe690376890 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.051314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.086982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.087670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.087949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.088222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.089061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:40.089367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.090912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64b82-0192-476e-acb4-dcc00facf2d1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.114400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 325/651] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:40.116095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.116423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.116814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.135307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:40.136653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:40.176177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da49105-740c-40bc-9f55-c06a62481b1c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.197845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.214081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 326/652] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:40.218241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.219040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.219920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.220266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.220595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.233499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.235018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:40.256018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:40.257152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:40.258063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:40.258063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:40.258063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:40.258063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:40.258063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 327/653] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:40.258351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.339222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.350803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acaf5a-fe22-43dd-8bcb-4e99efadbb3e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.383621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282c76-6fb2-454d-826d-9c08406a0d2d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.392363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.396893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.396893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.396893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.409266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.412718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.424990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.425704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.426076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.426372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.427230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:40.427537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.428991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:40.432242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:40.433465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 327/654] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:40.434736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.444699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 328/655] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:40.445648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.479454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.551722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4b238-6ead-43b0-901b-d0cc79d7e96f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.554130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff60e1-448b-4d63-beea-bdc2b154b98f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.589869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.591218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.591502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.591782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.596897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.597845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.598556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.598556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.610231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:40.614843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:40.618400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:40.619510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:40.620419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 329/656] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:40.621328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.682698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.684234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.757311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.776327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643c3f-e5fc-496d-b681-fd617377dfbe None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.814894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 328/657] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:40.815754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.827346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.828033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.828315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.828588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.829324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:40.829631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.831097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.845011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 330/658] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:40.845891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:40.876614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:40.932563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426caf4d-4d3c-4d0f-ba00-dc1b3405c3bb None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.970888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:40.971470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:40.971751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:40.972022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:40.972903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe2bfd-55d8-4947-894e-efa0c1c4f05d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:40.973073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:40.973222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:40.974996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:40.999328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1139 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:41.000361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.018319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.019219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.019861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.020329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.021667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:41.022202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.024495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.034457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 331/660] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:41.035908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.059783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.176424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092afbb-78e3-483d-a6d6-eaa6124a11ed None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.189763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.212229 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88e42-4a24-4e05-8d3e-078b79f52cbb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.242115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.242115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.242115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.242115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.242650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:41.242793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.244252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.257120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.257471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 330/661] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:41.257982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.258270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.258432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.258563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.272150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.273679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:41.296135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:41.297875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 332/662] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:41.299973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.416067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.451922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95395d-a17f-41ae-b071-b047dd2adaa1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.465924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e72c21-c8fa-462a-8cd9-1237df1b796e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.496684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.497687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.498191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.498574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.508486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.509918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.527934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.529045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.529335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.529620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:41.533155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:41.534139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:33:41.535296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:41.536479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 331/663] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:41.538140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.582048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.647063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.649506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.711627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec8a6-188c-4f30-af8b-5a87e7e6cf19 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.738880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.769715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:41.771476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:41.772344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:41.773017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:41.791885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:41.794761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:41.798914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 333/664] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:41.801607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:41.829827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:41.830844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:41.831767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:41.831767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:41.831767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:41.831767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:41.831767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 332/665] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:41.832863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:41.939765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:41.973160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668c45-67ef-44a0-a133-7e3708cbaf42 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:41.977046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8951f-e798-454a-a87c-cddd8abe3850 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.019853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.020993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.021345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.021488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.022310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:42.022552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.022718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.023192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.023472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.023752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.024009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.024593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:42.024903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.027145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.037692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 334/666] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:42.038583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.060529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Jun 28 17:33:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:42.061406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.090676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.184901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aabef-61ee-4013-bc07-923f608557db None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.206212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5de10-a8fc-4eb8-9038-8641f79079e3 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.226716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.227543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.227827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.228119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.241789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.243802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.261661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.262468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.262752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.263022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.263767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:42.264075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.265494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:42.267649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:42.271347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:42.274043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.280097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.289573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 334/669] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:42.290409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.387382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.437967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d76c-55f7-44ca-aeaf-816807741a7a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.474115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5d599-e7c6-420b-8cc6-93b15915b24b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.488885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.490314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.490817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.491312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.504166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.506850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.528769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.529324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.529601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.529869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:42.534905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:42.536310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:42.537169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:42.537618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 336/670] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:42.538670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.634855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.640330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.642955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.726628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354965e-78b7-4331-9984-4361d4d37627 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:42.797277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:42.798314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:42.799170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:42.799701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:42.800953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:42.801501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:42.804179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:42.815031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.824958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 335/671] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:42.824958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.839169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 337/672] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:42.839169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:42.957926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:42.962005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78724644-988c-4ced-b3b6-e0e818047de1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.008336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.009370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.009650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.009925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.021557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3f599-f061-4d38-bebd-4e70d1b60e03 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.023842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.026304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:43.054783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:43.055942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:43.057034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 336/673] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:43.058748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.084008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.084681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.084965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.085233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.086057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:43.086383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.087857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.108285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 338/674] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:43.108285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.186289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.201926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a0ae-ad5e-4a05-90c6-9090532adc50 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.237512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd04c0e-6904-489d-9ab9-2415d3aca05f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.262997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.263850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.264129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.264396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.277504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.279168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.283250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.284569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.285796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.286287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:43.299680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:43.301444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:43.302612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:43.302612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:43.302612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:43.302612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:43.307866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.308043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 337/675] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:43.308043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.308310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.327182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:43.333798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:43.335767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:43.337562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 339/676] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:43.338562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.447337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b549-029d-4ebc-9324-1b171c7a9c0d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.476001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeea98-146b-41a7-8a3f-f6e7aadc3f51 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.483902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.484588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.484861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.485134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.486034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:43.486482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.487966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.496150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.512759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 338/677] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:43.513512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.514617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.515293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.515584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.515862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.516710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=7d734accab24459a8a6848029c1f6315) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:43.517015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.518538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.525211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 340/678] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/role_assignments?user.id=7d734accab24459a8a6848029c1f6315&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:43.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.641630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.674331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69b896-4ebc-41dd-ae64-61f5cdc80db9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.702522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d4da-811f-4ed7-961b-11d8595b3cb8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.731653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.732357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.732640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.732919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.733766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:43.734967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.735864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83dc48-35d0-4e6f-9a91-b4da53a28e3d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.758523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 341/679] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:43.761046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5705b-f3d5-489c-9cb1-7f59f926863e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.761536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5705b-f3d5-489c-9cb1-7f59f926863e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.762057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5705b-f3d5-489c-9cb1-7f59f926863e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.764871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 342/680] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:43.766533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5705b-f3d5-489c-9cb1-7f59f926863e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.783328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.784009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.784287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.784564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.787401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:43.787678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:43.788994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:43.802832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 339/681] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:43.804322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:43.838810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.924559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5705b-f3d5-489c-9cb1-7f59f926863e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.956719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9423a18-bd30-448d-95b5-24c3454215f1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:43.969195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.969871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:43.970184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:43.970461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:43.990998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:43.998743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:43.999871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.000356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.000899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.001858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=51413215fe6d42f7a76a6764c2a993cb) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:44.002208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.003735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd281f75-4dc6-403a-9b28-000b486251b1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.018003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/role_assignments?user.id=51413215fe6d42f7a76a6764c2a993cb&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:44.018003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.018003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.018003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.044534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:44.046848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:44.062172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.064254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.126165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:44.187016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 341/683] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:44.188548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.231356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 343/684] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:44.232599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.339599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc66f-5d04-484b-9e8c-b9a9e01ec767 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.369832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:44.378730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2604d13-e7f2-4f17-893b-d3834bec8ad5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.383798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.384727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.385086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.385434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.393676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.395464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:44.411470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:44.412652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:44.413708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:44.414306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 342/685] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:44.415122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.428670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.429970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.430472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.431001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.447294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:44.455352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:44.456384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:44.457583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:44.458499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.461571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:44.548937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09631a37-f82d-4be0-863d-e403be0990ed None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.576338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e551721-3931-4e81-8a5c-49fa58b4a008 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.589798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.591050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.591478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.591999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.605353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.607368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.615983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.616685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.617586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.617586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.618312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:44.618685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.620393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:44.630644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:44.631785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:44.632787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:44.632787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:44.632787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:44.632787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:44.635005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:44.636049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 345/688] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:44.636337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.645714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.681655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:44.758535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:44.764868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85e5b8-d50a-40f8-a413-88e041ef32d5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.808055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.808761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.809109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.809513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.810388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:44.810764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.812237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.822640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 344/689] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:44.823768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:44.830681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b7034-5378-4e65-b83d-7922451f54d7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:44.875815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:44.876612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:44.876972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:44.877323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:44.878268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=5fabfc6086e244db994a4bbbbbdfc5b7) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:44.878687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:44.880953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:44.896326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 346/690] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/role_assignments?user.id=5fabfc6086e244db994a4bbbbbdfc5b7&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:44.896326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.018430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:45.022189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbef39-c1e1-4f6f-b8ad-aeeced98b86d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.102885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.103976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.105059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.105554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.106780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:45.107564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.109985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.118270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebf46-46fd-4292-ac1a-241e6e6d6e92 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.129232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 345/691] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:45.136004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.166857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:45.183928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.184307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.184531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.184832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.199213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.201203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:45.222230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:45.223266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:45.224234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:45.224234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:45.224234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:45.224234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:45.226801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 347/692] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:45.232137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.285964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba29cb2-fd23-470c-b9b9-3825b90e5bae None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.326235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.327070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.327360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.328465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.335955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.337561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:45.354087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:45.355061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:45.355966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 346/693] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:45.361629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.370074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84f45-24ce-4cbd-a5cf-0a22bdd9d9f1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.385959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:45.414504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.415670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.416182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.416672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.417729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:45.418272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.419977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.436919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 348/694] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:45.447212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.481476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd170501-6a27-485a-b8c3-ed62dfa71e8e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.523068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:45.528433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.529120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.530299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.530299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.530562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:45.530882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.534227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.558000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 347/695] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:45.564011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:45.654348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:45.682445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917d7d8-de62-4cd4-aa47-19dec8ec9800 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.704815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452f7df-e9cc-4dd3-9672-32dec0725ac7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:45.765896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.771715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.773890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.779838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.779838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=dc6c5d2d92294b1396bd6ca40db346bd) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:45.779838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.781916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.790354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:45.791753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:45.792250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:45.792742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:45.805591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/role_assignments?user.id=dc6c5d2d92294b1396bd6ca40db346bd&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:45.814915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:45.817846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:45.844124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:45.845136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:45.846106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:45.846963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:45.855824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:46.117531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11970a-0d6e-4775-88b9-53de7f245f20 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:46.198990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:46.200091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:46.200620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:46.201104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:46.202205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:46.202745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:46.204458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503d4d-ee2d-44e5-bcd5-2d1356c88ed3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:46.224331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:46.230223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 349/698] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:33:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:46.236285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:46.405840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:46.414483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b088a8-6009-41c6-a5cc-2dd97f5bea00 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:46.479215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:46.480377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:46.480861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:46.481340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:46.618926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:46.621435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:46.683046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88a5d-7b29-4992-9fc0-3b765b24d7d8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:46.683493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88a5d-7b29-4992-9fc0-3b765b24d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:46.683931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88a5d-7b29-4992-9fc0-3b765b24d7d8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:46.686674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 350/699] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:46.702400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:46.703071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:46.703571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:46.741140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:46.743193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:46.837051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:46.845171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 350/700] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 28 17:33:46.854519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:46.903338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 351/701] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:46.940152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.091359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaa10a-23c2-48ca-ab79-c692a4333576 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.167738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.169127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.169425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334f2ca-0ce0-49f3-a4f0-beae2975e153 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.169862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.170100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.195215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.196616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.214761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:47.224454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.225645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.225645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.225962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.226634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.228069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-17b72f1c-1a35-46b9-a5f1-91dec5664af2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:47.243606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:47.245504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:47.247610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 352/702] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:46 2022] GET /identity/v3/services/network => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:47.249368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b49fef-a4cb-4438-b35f-5ca1a6047ce8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.249368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b49fef-a4cb-4438-b35f-5ca1a6047ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.249368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b49fef-a4cb-4438-b35f-5ca1a6047ce8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f2590f35-6dc3-4867-a125-8c0f6f4d4cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:47.251829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:47.253402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:47.255518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:47.255518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:47.255518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:47.255518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:47.255965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 353/703] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:47.257501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b49fef-a4cb-4438-b35f-5ca1a6047ce8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.259303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 351/704] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:47.266354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.266354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.266354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.291351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:47.292686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:47.348773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:47.382151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 352/705] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:47.383333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.479781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b49fef-a4cb-4438-b35f-5ca1a6047ce8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.516257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1490345-b6f1-443e-a094-2332adc0ca85 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.545742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.547374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.547823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.548272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.550004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] RBAC: Adding query filter params (name=network) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:47.550876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.553226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.557070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.557725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.558040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.558319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.559055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:47.559365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.560775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7138d-6a08-4669-929a-ea12968c50a7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.566325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 354/706] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:47.566325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.578265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 353/707] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:47.580033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f462-3d4b-4f43-959a-ec081228f09f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.580319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f462-3d4b-4f43-959a-ec081228f09f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.581792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817f462-3d4b-4f43-959a-ec081228f09f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.582404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 354/708] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:47.583510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817f462-3d4b-4f43-959a-ec081228f09f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.636370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:47.657153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:47.713340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b85f0-2b8e-4ed4-988b-98b2175d9451 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.715316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817f462-3d4b-4f43-959a-ec081228f09f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:47.753134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.753866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.754162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.754449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.762053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:47.762928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.763328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.763771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.764691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] RBAC: Adding query filter params (type=network) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:47.765143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.766762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.778825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:47.790326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 355/709] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:47.790568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:47.790690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-50caabd4-08b8-47c9-96c3-5d5d091605d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:47.826210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:47.827309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:47.828201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:47.828201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:47.828201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:47.828201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:47.829655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 355/710] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:47.832280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:47.832878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:47.833427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:47.862687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:47.865016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:47.995134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 356/711] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:47.998020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.012828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d6f6b-5067-4c87-b600-5a165a9359ad None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.018336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:48.060829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:48.110251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.111127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.111413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.111679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.121011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.122660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:48.138822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:48.140515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:48.142262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:48.145124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 356/712] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:48.146289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.162453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46c17b-fba1-4289-9eb3-f4320f67ef06 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.226702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.229039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.229794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.230527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.232155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:48.233032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.235847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.259170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 357/713] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:48.261147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.325052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045abe59-a4b6-414e-a664-5e0ff3610369 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.390455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.391788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.392257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.392725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.393857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.396429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:48.423168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:48.425708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:48.427390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 357/714] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Jun 28 17:33:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:48.428999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.446410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:48.453221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb5d8-167e-49e8-bb88-67912210c830 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.484715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:48.526218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.527344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.527825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.528352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.530251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:48.530776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.533281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.561860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 358/715] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:48.563633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.634489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296807d-e8f1-47af-b7c0-ebafc30ec54c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.708834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.709888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.710416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.710887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.712915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.715500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.757315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 358/716] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:33:48 2022] POST /identity/v3/users => generated 254 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:48.758924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.766096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7f8b2-5994-4c95-b9e6-9728def6d579 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:48.839364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:48.841142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:48.842101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:48.842867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:48.844773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:48.845632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:48.848741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:48.870108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 359/717] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:33:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:48.876621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:48.973464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:49.029065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:49.068869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490329-d05f-4430-a987-2b914476a8ff None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:49.129340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:49.130091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:49.130394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:49.130645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:49.131501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:49.131833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:49.133307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03f5ae-b4ac-40b8-8d9f-231a2f460eed None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:49.139735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8fced-039c-4901-8379-91f82216ff2e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:49.140531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 359/718] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:48 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:49.189023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:49.190238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:49.190773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:49.191549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:49.193225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:49.194140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:49.197049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a457319-638b-4e7a-b8d4-c0024f5f7f19 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:49.207824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 360/719] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:33:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:49.529610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451ecf-95d3-4917-ae7a-779b9d6b61ce None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:49.530141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451ecf-95d3-4917-ae7a-779b9d6b61ce None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:49.530388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c451ecf-95d3-4917-ae7a-779b9d6b61ce None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:49.532039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 360/720] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:49.537593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:49.538385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:49.538385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:49.562040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:49.563447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:49.693496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 361/721] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:49.730866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451ecf-95d3-4917-ae7a-779b9d6b61ce None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:49.904650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c451ecf-95d3-4917-ae7a-779b9d6b61ce None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:49.942223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:49.943054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:49.943336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:49.943615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:49.956119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:49.964698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:49.965703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:49.966553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 361/722] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:49.971917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:50.000971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:50.116336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86161-22be-45d9-87ed-97fc9e6ebf27 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:50.158100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:50.158815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.159135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.159446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.160766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:50.161073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:50.162593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:50.173757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 362/723] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:50.179317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:50.210440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:50.339433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4907951-6f3b-4f3d-8206-2b689230edf7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:50.390760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:50.391610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.391899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.392179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.405065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:50.406592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b7e3add5-4296-423b-b56a-22a530ab83ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:50.426949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:50.427856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:50.428800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:50.428800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:50.428800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:50.428800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:50.429166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 362/724] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:50.437294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:50.559840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:50.588633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc2903-4a2f-40d6-b08b-e4221cc91bbd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:50.608027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be8a-e0f7-4a58-b262-775f8e1765a9 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.608990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be8a-e0f7-4a58-b262-775f8e1765a9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.609701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968be8a-e0f7-4a58-b262-775f8e1765a9 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.612590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 363/725] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:50.620813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.621664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.622650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.648814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:50.649669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.649985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.650274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.651172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:50.651692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:50.653618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:50.669885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 363/726] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:50.675572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:50.677495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:50.679079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:50.861790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:50.883630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 364/727] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:50.912689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975cf04-d1c2-4c22-808e-ba1e8d4c93a4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:50.951014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:50.951732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:50.952029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:50.952347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:50.961360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:50.962866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:50.965662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:50.966057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:50.979977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:50.981637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:50.983502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 364/728] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:50.989084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:51.154628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7f36f-0550-443c-afd8-b0c679d92a54 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:51.228551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667fd64-97b1-425f-97b3-e07a549fab40 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:51.242182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:51.242969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.243147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.243413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:51.244157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:51.245612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:51.273902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 365/729] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:33:50 2022] POST /identity/v3/services => generated 240 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:33:51.325744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:51.326493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.326779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.327060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:51.327932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:51.328244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:51.329724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8b2e9-4653-444c-b8e7-38cf0042a76b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:51.364375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 365/730] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:33:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:51.370381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:51.431175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:51.490493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972198aa-317a-48b0-b269-fd03246e4a61 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:51.529108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:51.529791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.530117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.530394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:51.533801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e37d-a1b0-45cd-9113-7aad539f78c4 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.534116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e37d-a1b0-45cd-9113-7aad539f78c4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.534406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27e37d-a1b0-45cd-9113-7aad539f78c4 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:51.536373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 366/731] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:33:51.543294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.543649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.543856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:51.583556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:51.584453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:51.629997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:51.631849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:51.687864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:51.704129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:51.740274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 367/732] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:51 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 28 17:33:51.776550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 366/733] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:51 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 28 17:33:51.786853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:51.791191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:51.943018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72358e9-0b86-4b6d-931f-b6c4b027f553 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:51.997679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:51.998709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:51.999139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:51.999560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.015325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:52.023709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:52.025701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:52.027104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 367/734] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:52.031540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.046633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.120998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5394bc-4771-43f0-a709-b33af0fc1920 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.147642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e18758-586d-4bd6-b6ce-e809b23a9821 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.167963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.169018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.169478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.169870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.186052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.186495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:52.186749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.187037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.187319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.188088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:52.188401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:52.188744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:52.190059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c7295-3203-4532-b81f-b7aef027b253 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:52.204798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 368/735] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:52.206380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a891b5-0506-450a-8505-f9ef10ad09c7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.206829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a891b5-0506-450a-8505-f9ef10ad09c7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.207115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a891b5-0506-450a-8505-f9ef10ad09c7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.209304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 369/736] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:52.210264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a891b5-0506-450a-8505-f9ef10ad09c7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-16131738-e159-41ba-a536-9a6e3bb5a317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:52.216131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:52.217055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:52.218030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:52.218030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:52.218030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:52.218030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:52.222075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 368/737] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:52.223682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.223973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.224255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.243615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:52.244899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:52.282445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.339179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.376346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 369/738] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:52 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:52.377459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.386967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a891b5-0506-450a-8505-f9ef10ad09c7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.439599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.440866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.442065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.442520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.463447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:52.465641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-c5efd0b3-6f7d-4eeb-a680-55f866469c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:52.498892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:52.499937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:52.500873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:52.500873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:52.500873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:52.500873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:52.501610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 370/739] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:52.503535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790805fc-c4d8-46f2-b60d-ba068dc01c62 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.503936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790805fc-c4d8-46f2-b60d-ba068dc01c62 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.504695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790805fc-c4d8-46f2-b60d-ba068dc01c62 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.507181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 371/740] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:52.510946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790805fc-c4d8-46f2-b60d-ba068dc01c62 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.524840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc56ffe-2201-43ab-b07c-48f2c4525947 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.570032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.570818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.571222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.571617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.572484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:52.572958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:52.575049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:52.593107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 370/741] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:52.593107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.632023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.675551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790805fc-c4d8-46f2-b60d-ba068dc01c62 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.712074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.728418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.729567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.729880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.730408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.744270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:52.750442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2337c-f193-4491-bb66-0a8b0c6eaefa None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f141390b-c786-46f6-bd8e-3d68362d64f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:52.752100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:52.753200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:52.754330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:52.758576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 372/742] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:52.760085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.760375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.760658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.785595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:52.788399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:52.809481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:52.810710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:52.811214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:52.811690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:52.813073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:52.813451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:52.815853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:52.837838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 371/743] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:52.839890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.885925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 373/744] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:52 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 28 17:33:52.886864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:52.972135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:52.996491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b3039-7d59-4c16-a71a-1b549b8f3c6b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.052957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.054315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.055220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.055220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.066882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.069087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:53.093795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:53.095592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:53.105924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:53.106533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb931ce7-fc3e-4bf2-8622-548a398eff14 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.106635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 372/745] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:53.106635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.131078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:53.168858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.169914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.171016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.171464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.172753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:53.173251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.177542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.194137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 374/746] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:53.195101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.280235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96cd7-f915-4fab-8064-5f12791058ea None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.319194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.320133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.320416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.320696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.329961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.331675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.338035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77803b6a-9353-462c-a136-7a2906471ba6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:53.348521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:53.349714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:33:53.350682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:53.356612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 373/747] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:53.356612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.372381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:53.393659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.395212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.395386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.395716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.396637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.398290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.421262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 375/748] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:33:53 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:33:53.422690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.505851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:53.598393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837b9e-730a-4044-ae20-8c2ab708cf7f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.646293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14f19-38ca-423e-be32-0bdd31f9f060 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.663188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.664786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.665653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.666576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.668308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:53.669222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.672102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.702153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 374/749] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:53.703811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.713293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.714168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.714452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.714730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.735353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.735353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:53.763827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:53.764777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:53.765645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:53.765645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:53.765645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:53.765645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:53.766520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 376/750] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:53.768131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:53.828092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:53.897073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8788fa-d72a-471a-a94d-2b5089c73a3e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.933862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:53.941559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:53.943071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:53.943356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:53.943628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:53.944489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:53.944830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:53.946356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:53.966377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33076f2c-9cf6-4df8-a182-9ed24335791a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:53.972103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 375/751] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:53.973182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:54.014879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:54.016484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.016791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.017112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.018065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=dc6c5d2d92294b1396bd6ca40db346bd) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:54.018384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:54.019999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292427f-ca05-496d-838f-d42d82da5804 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:54.030401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 377/752] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/role_assignments?user.id=dc6c5d2d92294b1396bd6ca40db346bd&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:54.032503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903da78-0540-4862-a80c-adac87e9c495 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.032953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903da78-0540-4862-a80c-adac87e9c495 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.033422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903da78-0540-4862-a80c-adac87e9c495 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.043346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 378/753] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:54.044663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903da78-0540-4862-a80c-adac87e9c495 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:54.164901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b22ad0-8232-4e80-871a-e37d5e9910aa None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:54.222392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:54.244635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903da78-0540-4862-a80c-adac87e9c495 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:54.250417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:54.252241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.253281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.254210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.256060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:54.256918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:54.260205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf269a-e2bc-4210-a8ee-9ccc8f40f063 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:54.285123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 376/754] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:54.286940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:54.287739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.288084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.288446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.289485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.290366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.291135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.312102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:54.326052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:54.328826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:54.401599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:54.405419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:54.482363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 377/755] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:33:54.482363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:54.647157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 379/756] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:33:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:33:54.649198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:54.674441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600ea6a-1726-4b23-b37c-9f7ed1bb6f1b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:54.711461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:54.766774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:54.772535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:54.772535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.774567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.774567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.796912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:54.799515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:54.820489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:54.821495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:33:54.822476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:54.830408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 378/757] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:54.831873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:54.890802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa8ad0-d880-4e43-97b0-5c6b3463553f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:54.953115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:54.954451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:54.954969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:54.955446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] PATH_INFO: `/v3/services/network` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:54.956340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:54.958060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:54.973392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:54.974817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:33:54.975644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:54.976804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ba08-197d-4208-a6b9-6897196210ee None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:54.978768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 380/758] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:54 2022] GET /identity/v3/services/network => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:54.980016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.051681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.052916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.053405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.053883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.067721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.069702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:55.099253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:55.100180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:55.101039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:55.101039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:55.101039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:55.101039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:55.103131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 379/759] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:55.104319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.138775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:55.160140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9966-c79b-4782-9504-500852705fc8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.189791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:55.217646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.218759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.219269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.219771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.220902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:55.221420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.223555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.248304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 381/760] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:55.249670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.287099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5a7b9-a843-4ce4-bb71-d16a92755543 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.350201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.351267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.351755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.352240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.353579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:55.354152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.356617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.370298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 380/761] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:55.371960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.372823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c816f-8df6-4b1f-96e0-6ea25c39962e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.412677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.414525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.415013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.415503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.416522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:55.417068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.418745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.434194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 382/762] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:55.435539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.476409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:55.567454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb48b1-d1ba-4a9f-a083-834eab3fef30 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.571535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:55.594739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058efec-a281-4e2e-9eb0-66e02de6bcb2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.612354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.612774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.613614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.613614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.614625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] RBAC: Adding query filter params (type=network) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:55.615063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.616609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.629979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 383/763] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:55.629979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.673130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.675761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.677347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.678088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.699043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.702233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:55.738640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:55.740633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:55.742650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:55.742650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:55.742650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:55.742650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:55.746049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 381/764] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:55.747879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.750701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:55.791018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb87fb-8d6a-49d0-a224-9de109f92f96 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:55.861916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:55.865486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:55.866503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:55.867314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:55.883829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:55.887225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:55.913159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:55.914918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:55.916693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:55.921244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 384/765] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:55.923298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:55.961786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ccf2-3768-4f07-966a-cdf2c0a51a6f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.027892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.029036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.029504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.030054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.031566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] RBAC: Adding query filter params (interface=public, service_id=7a42a77c45934f3fbb47afa343fc19ad, region_id=RegionOne) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:56.032148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.034855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.057989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 382/766] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/endpoints?service_id=7a42a77c45934f3fbb47afa343fc19ad&interface=public®ion_id=RegionOne => generated 194 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:56.059678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:56.079960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:56.136911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c7f90-09a4-47ce-96ef-4f883662e4e3 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.209079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.210237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.210777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.211270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.212267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:56.212798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.214534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.233067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 385/767] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:56.234814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:56.256760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:56.293448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd548d-5a10-4073-a686-8f35f7ffecfc None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.354095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.355769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.356264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.356922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.358109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:56.358652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.360894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.379455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 383/768] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:56.380714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:56.389122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5c01e-3227-4cc0-894f-d7972bb0019d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.467894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:56.479700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.481048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.481542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.482026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.482904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.484675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.491797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:33:56 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:56.492946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:56.528623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72aa0c-45c6-498a-9d60-8a7464e20fa8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.598687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.600339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.600865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.601721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.615858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.618592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.633407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:56.668412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000f48f-d4f8-4bb5-ab87-090823d877f4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:56.715139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:56.716227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.716774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.717285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.718406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=25c81a07126a425e9f4b7abfccaddab9) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:56.718949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:56.720687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745b382-853b-464f-b269-0136a0f451d1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:56.728248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 387/770] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:33:56 2022] GET /identity/v3/role_assignments?user.id=25c81a07126a425e9f4b7abfccaddab9&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:56.730056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d52d-157c-47d0-b55c-4f93c5b29235 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.730584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d52d-157c-47d0-b55c-4f93c5b29235 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.731060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5d52d-157c-47d0-b55c-4f93c5b29235 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.733195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 388/771] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:56.742943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1f7b-22fe-4391-a6a2-7c1841c532df None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.743606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1f7b-22fe-4391-a6a2-7c1841c532df None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.744094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1f7b-22fe-4391-a6a2-7c1841c532df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.778334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-812a1f7b-22fe-4391-a6a2-7c1841c532df None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:56.780157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-812a1f7b-22fe-4391-a6a2-7c1841c532df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:56.823596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:56.824899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:56.825798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:56.830479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 384/772] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:56.835560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:56.879271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 389/773] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:33:56.881890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fbd9-6598-4075-85d4-64f4d8ba0204 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.882766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fbd9-6598-4075-85d4-64f4d8ba0204 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.883260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fbd9-6598-4075-85d4-64f4d8ba0204 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.885559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 390/774] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:56.904060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:56.904690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:56.905191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:56.936916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:56.938988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:57.047340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646914-fdd8-48e8-b4c8-cf57b3e1f04c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:57.101176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:57.110118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 391/775] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:33:57.111943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:57.121809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:57.142946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:57.144048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:57.144048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:57.145118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:57.146558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:57.147095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:57.149806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:57.177318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 385/776] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:57.179363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:57.320451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e47a77-75ab-4011-899f-7ed316728a7c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:57.382988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8858716-1519-4b64-a909-194c77cab80c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:57.389715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:57.391580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:57.392344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:57.393073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:57.414327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:57.429581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:57.431689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:33:57.433374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:57.437865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 392/777] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:57.445000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:57.463783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:57.465069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:57.465611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:57.466151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:57.467432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:57.470805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:57.497894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:57.499685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:33:57.502223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:57.507413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 386/778] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Jun 28 17:33:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:57.508378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:57.585833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:57.623772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:57.665645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916731c8-96bc-4f9e-98b1-64ad5834f0b2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:57.685378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5550dc-3cd2-4f54-a197-d122bfddd56b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:57.726640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:57.727704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:57.728305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:57.728809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:57.729159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:57.730008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:57.730509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:57.730735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:57.731218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:57.731698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:57.732705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:57.735155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=ef1eedbaa7574783adde2884c2b9a482, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:57.737751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:57.748753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 387/779] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:57.748753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:57.773974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 393/780] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:33:57 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:33:57.773974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.022438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9408-04d8-4ace-9617-0e986ef32405 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.053073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87cac0-59f8-4624-aff9-3457a0c27bba None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.054175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:58.092728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:58.094973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.096361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.096841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.097362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.132495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.135244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:58.166465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:58.167448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:58.168335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:58.168335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:58.168335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:58.168335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:58.169887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 394/781] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:58.170755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.171465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.171747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.172027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.172745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:58.173047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.174839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.179409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.185639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 388/782] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:33:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:58.197419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.399047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9237e5-7da3-40b9-9deb-a1c1bbc9d87f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.402356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028fbb3-0826-4016-8d65-7952a4542ea7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.475798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.476942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.477780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.478370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.479650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:58.480150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.482690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.485810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.486540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.486923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.487191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.487962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:58.488352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.490075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.507896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 395/783] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:58.513351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 389/784] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:58.515455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.520650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.586191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:58.603707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:58.739406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1d2c1-f6c2-4452-8779-7e50585b6988 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.765463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f65bdd-7ed1-4ce9-a95d-3445d9092061 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:58.828194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.828886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.829171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.829443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.830286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] RBAC: Adding query filter params (interface=public, service_id=4151db3f3a1c4f6086e3e40c8faf6357, region_id=RegionOne) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:58.830601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.832103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.852498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:58.853980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:58.854461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:58.854952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:58.859383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 396/785] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/endpoints?service_id=4151db3f3a1c4f6086e3e40c8faf6357&interface=public®ion_id=RegionOne => generated 194 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:58.865820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:58.882127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:58.884903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:33:58.914699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:58.915704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:58.916628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 390/786] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:58.926623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.085007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:59.091588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1221d-6ffb-4618-9b2a-d456a73b82ce None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.107307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:59.116819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe2c0-61ca-4595-b0dc-51f3fdf0f6d8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.142432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.143670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.144249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.145099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.145759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:59.147635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddef8c-c17d-4c73-8137-4d5766e38d5f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:59.158337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 397/787] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/services => generated 772 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:59.161528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c88260-9a1c-4dc3-897b-5dfb0fc71336 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.162174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c88260-9a1c-4dc3-897b-5dfb0fc71336 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.163008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c88260-9a1c-4dc3-897b-5dfb0fc71336 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.165078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.166027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.166451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.166837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 398/788] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:59.167025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.168016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:59.168484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:59.170097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:59.175197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.175747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.176209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.192309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 391/789] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:33:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:33:59.199859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.239321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:59.241313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:33:59.318372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936be11f-9801-462a-af3d-54ca78845dfe None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.371585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.372803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.373240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.373755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.395087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:59.403141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:33:59.433681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:59.434682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:59.435673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:33:59.435673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:33:59.435673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:33:59.435673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:59.442361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 392/790] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:59.444559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.463469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:59.501562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 399/791] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:33:59.561222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e6a1-617e-469a-9adf-3e67b3844d84 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.561446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.602979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.604391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.605152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.605873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.607550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:33:59.608360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:59.612128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:59.635938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 393/792] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:33:59.645464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.724800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:59.737252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106c8b-e607-4b1e-b9e4-1cf8c16b24f2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.759937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:33:59.808282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68d385-9e5d-4662-8294-e13f5b4c7282 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:33:59.809023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.810715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.812503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.812972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.837754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d2ebb071-b79c-4d82-a2d6-cb5434f0a6af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:33:59.848745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:59.849753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:33:59.850615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 400/793] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:33:59.855297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f4e-4541-4ac6-80e3-03dfdf6999eb None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.855297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f4e-4541-4ac6-80e3-03dfdf6999eb None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.855297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb67f4e-4541-4ac6-80e3-03dfdf6999eb None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.855297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 401/794] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:33:59.856206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb67f4e-4541-4ac6-80e3-03dfdf6999eb None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:33:59.866098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:33:59.867469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.867954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.868441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.881908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:33:59.883742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-f430a0d7-f5cc-44ae-92f7-23f47c2f1199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:33:59.904522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:33:59.906546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:33:59.908367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 394/795] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:33:59.913964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:33:59.913964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:33:59.913964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:33:59.952022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:33:59.954702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:00.043461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb67f4e-4541-4ac6-80e3-03dfdf6999eb None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.093678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.094883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.095496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.095980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.097007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:00.097659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.099418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.110035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 395/796] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:33:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:00.112951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.118442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 402/797] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:00.130005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.162697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.196150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.241607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db239c80-0cf9-431e-b056-3b185dfc28c9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.279522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.280380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.280725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.281150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.282034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:00.282408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.283919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.284066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945f927-efc7-43e7-b8f1-46b48e86d6f7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.303790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 396/798] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:00.304995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.328613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.330083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.330377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.330656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.350511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.352510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:00.379943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:00.381623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:00.383465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:00.383465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:00.383465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:00.383465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:00.389966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 403/799] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:00.389966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.420973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded2a67-9d4b-4ecd-a29d-90c611681fb8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.442802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.459034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.459855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.460130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.460396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] PATH_INFO: `/v3/services/network` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.461051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.462495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.470404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:00.474840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:00.475834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:00.477081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 397/800] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:00.477858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.521155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e97fe-4ae7-4fca-a75e-855e8dc68f78 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.570094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.571049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.571336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.571668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/dc6c5d2d92294b1396bd6ca40db346bd/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.573712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=dc6c5d2d92294b1396bd6ca40db346bd, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.575293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875b739-c795-4aa1-bc96-6caaf139980a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.592793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 404/801] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:00 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/dc6c5d2d92294b1396bd6ca40db346bd/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:34:00.593928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cf7f-d1fe-4890-96b4-38056a8f3220 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.594297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cf7f-d1fe-4890-96b4-38056a8f3220 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.594584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112cf7f-d1fe-4890-96b4-38056a8f3220 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.600420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 405/802] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:00.601274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112cf7f-d1fe-4890-96b4-38056a8f3220 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.610457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0598-f700-4269-9b64-6129671e3396 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.702730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.704452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.705683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.706609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.710140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:00.711854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.716271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad2cb7-9377-4b16-adcf-80f05f2e0cbb None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.749998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 398/803] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:00.749998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.749998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.749998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.774563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112cf7f-d1fe-4890-96b4-38056a8f3220 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:00.783127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:00.786314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:00.807608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.825324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:00.826048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:00.826336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:00.826619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:00.827347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] RBAC: Adding query filter params (name=network) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:00.827660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:00.829061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:00.838402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 406/804] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:00.839979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:00.878453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:00.926792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 399/805] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:00.928600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.073520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cd4f8-3504-446e-84f4-a56d6afebfce None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.144886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277d74a-0b8d-4dd8-b729-b84504dcaaef None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.149501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.151805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.152031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.152615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.169490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:01.172337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:01.203956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:01.205833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:01.207612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:01.215057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 407/806] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:01.215057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.227396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.228810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.229493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.231138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.232654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:01.233395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:01.236821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:01.256523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 400/807] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:01.258268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.326918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:01.354344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:01.417759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8af38-3664-4699-aa8a-bd9f5e8c2332 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.458569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d2cd-a732-46c5-9dda-f98b7f0860e7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.482850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.484650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.485436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.486211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.506631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:01.522690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:01.524501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:01.526100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:01.528663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 408/808] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:01.531233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.531523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.532764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.533414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.533974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.535729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:01.536293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:01.539215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:01.580357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 401/809] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:34:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:01.580357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.734962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a48412-6156-42dd-a4cb-2fe211c2a01c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.757187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:01.774358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:01.782523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e0536-5232-44a6-9369-c8791d38c0a9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:01.818594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.819998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.820490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.820974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.822469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:01.825318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:01.864370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:01.865558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:01.866274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:01.866771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:01.868371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:01.868911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:01.872052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:01.878629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 409/810] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:01.882072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:01.914260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 402/811] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:01.918882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.070397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621091a-1d8c-4cd7-a19c-a514cc40f9d6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.109802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.110741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.111023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.111342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.127432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.129423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.135536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf63c0-2cda-4bae-b986-b8c40425594a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-0cb46c44-bf12-476a-95bb-028c0eeddc9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:02.150285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:02.152381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:02.153538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:02.153538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:02.153538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:02.153538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:02.153538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 410/812] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:02.153872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36559-325a-4bfe-9ab0-980d8114e6cf None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.154126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36559-325a-4bfe-9ab0-980d8114e6cf None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.154407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d36559-325a-4bfe-9ab0-980d8114e6cf None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.155988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 411/813] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:02.164224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.165115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.165890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.186824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:02.187441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:02.200383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.213205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.216691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.216691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.216691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.232180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.234901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:02.259775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:02.260702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:02.261553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:02.261553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:02.261553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:02.261553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:02.264019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 403/814] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:02.265124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.280733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.308896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 412/815] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:02.310141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.411102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576c4ac-a576-4ec3-a276-a9d412e94b9f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.452331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.453012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.453293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.453565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.454329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:02.454634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.456101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.460797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7602c-c9bb-4ab4-9246-c8c99d8f6d93 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.476571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 404/816] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:02.476571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.523092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.524030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.524483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.524930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.526130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:02.526598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.528808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.549961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 413/817] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:02.549961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.554711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.592750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.630123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace53f-5818-464a-bee4-24cf6e3713c7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.673274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.674631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.674934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.675199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.677472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.678960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:02.693978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:02.704071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:02.705583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 405/818] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:02.707294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.733387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a5b0-bc52-4caa-a5a1-0a1a1042e254 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.794431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.795697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.796173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.796653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.809459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.811053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:02.827878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:02.830724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:02.832805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:02.834325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 414/819] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:02.835967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.848580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5d43c-e920-42b5-b8d4-34fc38d9ad83 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:02.891012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:02.891959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.892173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.892443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.894950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.902882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:02.905610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-dd33da1f-242d-4a0d-9309-96029b4442b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:02.931232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:02.932978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:02.934981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 406/820] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:02.936208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272080-0cc3-4b41-b84b-b8769510d7b8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:02.936208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272080-0cc3-4b41-b84b-b8769510d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:02.936465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272080-0cc3-4b41-b84b-b8769510d7b8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:02.939242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 407/821] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:02.940915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272080-0cc3-4b41-b84b-b8769510d7b8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:02.950266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:02.999354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddf0c8-a5d5-44af-9845-bbfefc34abb7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.040356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.041526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.042072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.042576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.043913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:03.044492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.047217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.056320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 415/822] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:03.057597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.088337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272080-0cc3-4b41-b84b-b8769510d7b8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.127652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.128320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.128698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.129066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.130251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:03.130554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.132039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a29b0-6d20-4d04-b99b-4277fc7d989f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.145538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 408/823] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:03.146917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.147271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.147554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.165903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:03.167240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:03.202514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c2824-5d56-44f8-8ef8-e06bb10f8f7f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.222415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.243412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 409/824] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:03.244311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.270131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.281599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.282322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.282603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.282876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.283751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:03.284059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.286095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.309454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 416/825] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:34:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:03.310765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.391600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde192e-db74-4892-94f1-f7e63f0b2244 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.436720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.437788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.438250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.438721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.440021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:03.440553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.442999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.451672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 410/826] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Jun 28 17:34:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:03.452871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c8ab-bb92-4a6e-b2fe-4fb97c2198ed None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.453170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.497423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.498654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.498926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.499196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/25c81a07126a425e9f4b7abfccaddab9/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.516284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.519419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=25c81a07126a425e9f4b7abfccaddab9, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.521378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.537436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 417/827] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:03 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/25c81a07126a425e9f4b7abfccaddab9/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:34:03.538407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.596477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c76654-e787-456e-ad1c-dd43189b0f52 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.620884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.648313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.649161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.650013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.650307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.668579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:03.684206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:03.686069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:03.687743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 411/828] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:03.689083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:03.743971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59c5c4-42ea-44ff-834d-40e037154529 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.811255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.813009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.813494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.814037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.853455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8263b7-0453-4caa-bfa0-1b645ef280cd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:03.872039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.907971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.909927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.916944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:03.918086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:03.918555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:03.919041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:03.920381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:03.922973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:03.958133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 412/829] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:03.958671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:03.960125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.145867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04762d0d-b954-4340-b954-e8f835934914 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:04.188701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:04.189413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:04.189696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:04.189990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:04.190778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:04.191615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:04.193165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:04.204240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 413/830] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:04.213124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.269611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:04.300548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 418/831] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:04.309400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.417663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d324d7a-c71e-4d8d-811d-7c4b9fc8494b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:04.484477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:04.485578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:04.485578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:04.486018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:04.501296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:04.503136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:04.506181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4757f5-d1e3-444e-a5ee-dfaa873f4ddc None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:04.524834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:04.526853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:04.529012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:04.529012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:04.529012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:04.529012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:04.529012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 414/832] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:04.535455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.584671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:04.586109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:04.586631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:04.587098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:04.592894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:04.611277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:04.614172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:04.649608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:04.652685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:04.658977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:04.658977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:04.658977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:04.658977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:04.658977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 419/833] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:04.665979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.724517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:04.780946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6e3e7-6c17-4ff4-bbae-abd24027e68d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:04.851670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:04.853090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:04.853719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:04.854375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:04.855749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:04.856387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:04.859327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:04.870473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9878ae-6008-4abd-bbc4-5bc72a1478c9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:04.890129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 415/834] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:04.891977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:04.945529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:04.947001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:04.947588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:04.948224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:04.949721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:04.950508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:04.953171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:04.979090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 420/835] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:04.987968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.082650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:05.094815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88e9fa-5404-4b58-ba13-779625867567 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.142527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.143394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.143972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.144498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.147174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:05.155099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.157386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:05.177152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:05.179290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:05.187855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 416/836] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:05.189885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4dd0e-7edf-4833-a065-d3a0f6a55c2d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.193352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.250067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.252056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.252833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.253790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.267602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.271106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:05.299202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:05.301005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:05.303218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:05.307211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 421/837] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:05.315321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.329121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c742d8-4d4d-402d-b959-e7e7f5777d62 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.392800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.394021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.396010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.396815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.398200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:05.398723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.401193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.435238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 417/838] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Jun 28 17:34:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:05.436034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.466937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f3b67-3406-48e6-b10b-d9b344e71f02 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.480638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:05.509045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.510181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.510660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.511170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.512150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:05.512672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.514343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.529497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:05.530354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:05.538173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.559334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e024af-3762-4a17-8962-9d812880fa4c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.597426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.598552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.598552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.598745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.674267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.676614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.736600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:05.744804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c37967-dce1-4bda-954d-6cb738579169 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:05.801759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 418/840] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 17:34:05.802811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:05.821838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:05.823567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:05.824403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:05.825120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:05.826863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:05.827748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:05.830453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:05.843389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 423/841] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:05 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:05.981148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d0299-cb03-4122-8a36-d2e0f71c2926 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.055066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.056267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.056543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.056811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.075888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:06.078789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-86b3c8fd-f0ab-4aa4-acd5-294a39c3f57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:06.115303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:06.116998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:06.118848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:06.118848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:06.118848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:06.118848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:06.118848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 419/842] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:06.131021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.201873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:06.265545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061f95-9c73-4572-943d-55873887e97c None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.265887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061f95-9c73-4572-943d-55873887e97c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.266171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061f95-9c73-4572-943d-55873887e97c None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.268938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 420/843] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:06.273788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.274114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.274398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.280950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:06.295034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:06.296459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:06.321038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc493481-57c3-46d6-bd25-4a5511e420f5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.361757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.362719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.364005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.364502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.365490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:06.365956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:06.367607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:06.381789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 424/845] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:06.382109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 421/845] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:06.393070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.398914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.516896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:06.528416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623298c-9b1c-4c5f-9b4c-971fc3750cc7 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.529771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671bd47-7f5e-4688-8b63-3e1a2e23949b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.575659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.576768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.577121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.577580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.580621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:06.582012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.583697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.583883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.584214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.593295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:06.594826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:06.596234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-50d2d4cb-ba32-467e-8c9a-7f2e29ab7069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:06.605527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:06.607208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:34:06.608773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:06.610620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:06.612141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:06.615948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:06.617791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 422/846] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:06.617791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f88-2921-4590-a78e-bd5af430dd2a None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.617791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f88-2921-4590-a78e-bd5af430dd2a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.617791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00f88-2921-4590-a78e-bd5af430dd2a None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.618923 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 425/847] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:06.619147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 423/848] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:06.619490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.619733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00f88-2921-4590-a78e-bd5af430dd2a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.789429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00f88-2921-4590-a78e-bd5af430dd2a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.794464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35756ae-1c87-420a-a0c9-4c56b4d89b39 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:06.849513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.850510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.850958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.851401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.852685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:06.853169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:06.854002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:06.855007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.855448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.855769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:06.855938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.857061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:06.857545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:06.859787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8ac2b-43e7-41c5-82d1-460afc4778ab None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:06.884430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 426/849] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:06.884430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:06.884430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:06.884837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 424/850] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:06.884984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:06.886087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:06.912326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:06.914315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:06.932458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:06.986606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:07.038632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 427/851] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:07.039878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.084227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b1e7d-e8b8-4245-ab5c-0aa8d1c40dc8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:07.148354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:07.149295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:07.149732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:07.150214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:07.151435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=dc6c5d2d92294b1396bd6ca40db346bd) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:07.151942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:07.154426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:07.173981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 425/852] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:06 2022] GET /identity/v3/role_assignments?user.id=dc6c5d2d92294b1396bd6ca40db346bd&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:07.173981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.248410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557fe0-6100-467a-a2b2-1be23505919d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:07.316324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:07.318102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:07.318612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:07.319115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:07.344677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:07.348914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:07.361789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:07.373726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e852d4-239f-485f-b28c-b507a49544dd None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:07.388995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:07.390961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:07.393009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:07.393009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:07.393009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:07.393009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:07.393881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 428/853] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:07.403609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.410428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:07.454263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:07.455322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:07.455777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:07.456224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:07.458095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:07.460571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:07.483142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:07.499849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:07.502708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 426/854] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:07.506219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.690713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc10a8-3b94-49f5-9d3d-5ce2e7f608d6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:07.749335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b119-7912-4447-9d4d-6cc5e0f5a058 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:07.788698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:07.789390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:07.789671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:07.789961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:07.790710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:07.791016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:07.792448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:07.821037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 429/855] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:07.829506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.833697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:07.836091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:07.837859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:07.838871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:07.840231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:07.842015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:07.844216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:07.864165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 427/856] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:07.877188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:07.962032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:08.041717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:08.067533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9b0d8-5239-4d56-9e79-c6b2b1771631 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:08.116545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73488d-89fd-42ee-8ce9-c8b6a43f936d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:08.155421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:08.156261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.156525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.156789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.168029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:08.169500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:08.170990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:08.174184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.175011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.176260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.177919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:08.179168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:08.182093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:08.187033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:08.188858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:08.190702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:08.194128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 430/857] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:08.195153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:08.206309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 428/858] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:08.371540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28affb5-6e99-4ee4-b90d-bb1fb136e4f4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:08.411551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:08.450740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:08.451713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.452114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.452539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.453534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:08.455413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:08.456258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e322600-8082-4e9d-83a6-24b74d4e6123 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:08.487318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 431/859] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:34:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:08.495565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:08.688666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14ae14-e7e5-43bc-bd1e-45f364b50408 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:08.710696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:08.756165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:08.760966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.760966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.760966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.817512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d5039-8231-47db-9967-074da6b0c582 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.818025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d5039-8231-47db-9967-074da6b0c582 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.818827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d5039-8231-47db-9967-074da6b0c582 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.823926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 432/860] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:08.829162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:08.829470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:08.829780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:08.851538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:08.853138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:08.900310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:08.903065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:08.958139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 433/861] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:08.980945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.092528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 429/862] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:09.102453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.119884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:09.183920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859e63c-0919-4b58-8265-a398db4a5d3b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.189273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:09.252175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.253078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.253611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.254176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.255140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.256806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.263080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb98db4-506a-4259-b963-5e56e3dec2c5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:09.270915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:09.273044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:09.275138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 434/863] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Jun 28 17:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:09.279883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.359825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21062968-978c-4902-845e-522334a34bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.360657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21062968-978c-4902-845e-522334a34bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.360987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21062968-978c-4902-845e-522334a34bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.361261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21062968-978c-4902-845e-522334a34bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.379500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21062968-978c-4902-845e-522334a34bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.385055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21062968-978c-4902-845e-522334a34bc9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.410880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8efc76-32fd-4784-8f65-0e003ff33095 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-21062968-978c-4902-845e-522334a34bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:09.424563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:09.427550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:09.429366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:09.429366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:09.429366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:09.429366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:09.429366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 430/864] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:09.431793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21062968-978c-4902-845e-522334a34bc9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.499715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.501026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.501495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.501992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.503252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:09.503806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.506059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.513463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 435/865] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:09.520734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:09.521418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.565799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21062968-978c-4902-845e-522334a34bc9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.585963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:09.648859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.650134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.651570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.652070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.654032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:09.654471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.656221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.677474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 431/866] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:09.683930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:09.705806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c283068-bb60-4f55-a872-a7467b3d2236 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.752610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.753485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.753896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.754230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.754958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:09.755287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.756834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.770346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 436/867] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:09.834709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cca7bc-e83f-4145-bc64-a081e12c46f5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:09.862712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:09.875598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:09.876614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:09.876993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:09.877365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:09.886160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:09.887767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ea09af45-7626-4c64-9528-35547b71f1b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:09.905707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:09.906697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:09.907574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 432/868] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:09.913892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:10.051190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05d0d-ca5b-45bb-9d93-2e2eb950e4f9 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.051596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05d0d-ca5b-45bb-9d93-2e2eb950e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.052028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae05d0d-ca5b-45bb-9d93-2e2eb950e4f9 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.054986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 433/869] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:10.061474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.061766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.062081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.072852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:10.081823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244652a9-5869-4f7f-bae2-a296985b53fa None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:10.102968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:10.106463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:10.128867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:10.129976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.129976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.130292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.131039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:10.131385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:10.132876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:10.150734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 437/870] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:10.158926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:10.212860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 434/871] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:10.248447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:10.312242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8790f-1a14-49e1-82a6-9acb793b9ffc None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:10.361832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:10.363210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.364350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.364846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.365930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=25c81a07126a425e9f4b7abfccaddab9) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:10.366453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:10.368420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:10.377326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 438/872] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:10 2022] GET /identity/v3/role_assignments?user.id=25c81a07126a425e9f4b7abfccaddab9&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:10.432714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11c2a1-e005-4591-b491-1a8f565bc1b4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:10.459212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:10.499057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:10.500648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.500980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.501262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.502320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:10.504577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:10.526996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:10.528547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:10.529365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:10.530645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 435/873] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:10.538744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:10.580978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:10.742449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601b1f-1710-4475-aa9a-8498891b2dad None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:10.808510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d473c11-a165-418f-a085-2057871a091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:10.809615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473c11-a165-418f-a085-2057871a091e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:10.811475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473c11-a165-418f-a085-2057871a091e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:10.812004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d473c11-a165-418f-a085-2057871a091e None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:10.812980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d473c11-a165-418f-a085-2057871a091e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:10.813507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d473c11-a165-418f-a085-2057871a091e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:10.815161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d473c11-a165-418f-a085-2057871a091e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:10.822168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 439/874] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:10.830838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:11.027326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae44d-c9e2-4ba0-8139-40b510509071 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:11.027677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae44d-c9e2-4ba0-8139-40b510509071 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:11.028001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dae44d-c9e2-4ba0-8139-40b510509071 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:11.032251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c77f78-8e71-4a72-9bbd-9a9856ab1b5b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:11.033651 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 440/875] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:11.035629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e6-6a8b-4f55-975c-ef401c8c5292 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:11.035922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e6-6a8b-4f55-975c-ef401c8c5292 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:11.036200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46909e6-6a8b-4f55-975c-ef401c8c5292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:11.054588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e46909e6-6a8b-4f55-975c-ef401c8c5292 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:11.055873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e46909e6-6a8b-4f55-975c-ef401c8c5292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:11.106776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:11.107490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:11.107777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:11.108055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:11.109016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:11.109215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:11.110695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:11.116787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 436/876] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:11.143436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 441/877] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:11.168355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:11.269273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:11.386608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8af30-f834-4def-8b52-46a82d073cb1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:11.457577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:11.458804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:11.459248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:11.459710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:11.461166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:11.463892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166bcaf-75dc-42cb-bb6d-db0b4afc05f7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:11.493193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 437/878] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:11 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:12.588749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b433-59f1-4d01-b782-dacdfb37c0b8 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:12.589556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b433-59f1-4d01-b782-dacdfb37c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:12.589687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2b433-59f1-4d01-b782-dacdfb37c0b8 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:12.592894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 442/879] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:12.602055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8fa6-81cc-42e2-ba10-cd7a5e558b5a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:12.603599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8fa6-81cc-42e2-ba10-cd7a5e558b5a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:12.604379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8fa6-81cc-42e2-ba10-cd7a5e558b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:12.635025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-17da8fa6-81cc-42e2-ba10-cd7a5e558b5a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:12.637747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-17da8fa6-81cc-42e2-ba10-cd7a5e558b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:12.796564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 438/880] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:12.822898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2b433-59f1-4d01-b782-dacdfb37c0b8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:12.853521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:13.020436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2b433-59f1-4d01-b782-dacdfb37c0b8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:13.043709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593383-f611-485e-9e3a-d234d5c17e4a None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.043979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593383-f611-485e-9e3a-d234d5c17e4a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.044337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593383-f611-485e-9e3a-d234d5c17e4a None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.046084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 439/881] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:13.052412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.052818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.053013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.072823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:13.074393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:13.089105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:13.089917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.090227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.090506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.091346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:13.092757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:13.111474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 443/882] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:12 2022] POST /identity/v3/services => generated 269 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:13.122607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:13.238349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 440/883] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:13.262535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:13.369220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:13.422982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9c718-6c1f-4d0d-b0a6-e08ef380bb06 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:13.490352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:13.491753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.492252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.492748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.512946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:13.530178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:13.533578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:13.535565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 444/884] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:13.541970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:13.709062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941973fc-9e27-4894-9eea-9501ebbcefd6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:13.784979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:13.793997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10032018-a361-42c3-9637-dc569f4dcefd None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:13.808961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 441/885] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:13.814790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:13.961589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ff539-4d84-4cd1-b32a-ed59ab4d0d81 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:13.978010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01ef4-69eb-4bb1-959c-a8589d89d8e0 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.979001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01ef4-69eb-4bb1-959c-a8589d89d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.979734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01ef4-69eb-4bb1-959c-a8589d89d8e0 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:13.990481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 442/886] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:13.994266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:13.995151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:13.995941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.026377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:14.027939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.029241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:14.029423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.029797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.030321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.034149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.050401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.053465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.056391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:14.091585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:14.093728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:14.095841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:14.095841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:14.095841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:14.095841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:14.099336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 445/887] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:14.110093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.178364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 443/888] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:14.211854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.305476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f13e5-75cd-4323-b3a7-fec82ec8c8e2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:14.378238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.381397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.382220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.383005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.385485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:14.386531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.390691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.397928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5769-b406-43d6-a5bd-7d9497e43db8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:14.424423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 446/889] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:14.430166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.444464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.445296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.445579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.445825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.446523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.447928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e18fbf87-8054-4e48-9b04-63f917fa8613 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:14.463640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:14.467359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:14.470572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 444/890] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:14.471381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73830-9bae-4497-b4c9-93ce966cab17 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.471381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73830-9bae-4497-b4c9-93ce966cab17 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.471381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba73830-9bae-4497-b4c9-93ce966cab17 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.471381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 445/891] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:14.475592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba73830-9bae-4497-b4c9-93ce966cab17 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.492930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.502939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.579791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c3fe-cce0-4048-808e-98f0902f5e78 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:14.633869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba73830-9bae-4497-b4c9-93ce966cab17 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:14.643673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.644795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.645200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.645606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.659654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.662597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.685822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.686804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.687236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.687643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.688535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:14.688954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.690584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5eec6-a27b-4f6a-a74e-bde01a9fc7e4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:14.690795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:14.692475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:14.693589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:14.707803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 446/893] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:14.708255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 447/893] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:14.708502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.708874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.709131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.709131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.734485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:14.736475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:14.854490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11687-de90-4d4f-8f1a-fde4e8e21e6a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:14.864510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.868103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 447/894] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:14.869418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:14.877736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:14.912313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:14.913122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:14.913399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:14.913673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:14.914606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:14.914977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:14.916533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:14.945064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 448/895] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:14.945064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.033373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a424a-1ef3-459b-a8c9-53bead931458 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.088541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda4cb-c16f-4fcf-b7a0-ea1d77b8bfa6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.097636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.098366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.098647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.098647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.099635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:15.099944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.101351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.114156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 448/896] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:15.114156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.143841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.145294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.145793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.146424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.147395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.148878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.173972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 449/897] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:14 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:15.173972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.201050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.233492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.295364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faf5af-b7bc-44f9-8869-880ed3279492 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.325275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3f04f-f241-4248-9bed-488576a9afc5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.344897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.346235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.346775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.347389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.368413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.369110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.369437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.369714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.370577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] RBAC: Adding query filter params (interface=public, service_id=7e315fdb46074d4abdd734924824ed55, region_id=RegionOne) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:15.370885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.372474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.385180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 450/898] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/endpoints?service_id=7e315fdb46074d4abdd734924824ed55&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:15.386944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.473986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.475495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.540263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.561354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd7f37-fcdc-466c-b1a4-8491119d6599 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.582523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.607195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.608642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.608954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.609231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.609989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.611368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d8196-1f63-4462-8bbf-a5e179346c75 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.619378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 451/899] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/services => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:34:15.620552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3675e-d921-45fe-a108-81cadb897f4b None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.620908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3675e-d921-45fe-a108-81cadb897f4b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.621192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3675e-d921-45fe-a108-81cadb897f4b None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.622642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 452/900] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:15.625153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 449/901] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:15.629159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df810350-dd36-4221-903f-368211767e43 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.629727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df810350-dd36-4221-903f-368211767e43 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.630200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df810350-dd36-4221-903f-368211767e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.634358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.656958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-df810350-dd36-4221-903f-368211767e43 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:15.658693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-df810350-dd36-4221-903f-368211767e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:15.766812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 453/902] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:15.776690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977b7a-fcb5-4001-8202-e05429142c3a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.792538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df810350-dd36-4221-903f-368211767e43 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.829351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.830120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.830402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.830675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.843449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.844932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:15.864636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:15.865591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:15.867033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:15.867033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:15.867033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:15.867033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:15.867033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 450/903] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:15.875313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:15.898639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.906952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:15.929118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df810350-dd36-4221-903f-368211767e43 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:15.974484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:15.975583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:15.976138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:15.976420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:15.977096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:15.978663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:15.998089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:15.999111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:16.001296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:16.004435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 454/904] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:16.012387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.034995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9035341-423b-4977-ade6-e193ed8ddeee None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.079946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.080547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.080827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.081097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.082130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.082545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.084427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.099820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 451/905] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:16.107520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.169393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ceb45-ec44-418f-90d7-1aa4ef2e1844 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.203933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:16.216037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.216835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.217184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.217527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.218360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.219230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.220960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.228733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 455/906] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:16.234368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.238600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd295b-658a-4e2c-bc2d-2887b91bacbb None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.253706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:16.287971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.290158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.290444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.291233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.303770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.306328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:16.325745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:16.326867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:16.328949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 452/907] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:16.336655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.394236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11596aef-379c-4e94-9b05-56e7c9b497a5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.441645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.443070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.443628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.444122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.445089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.445445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.447546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.455494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 456/908] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:16.463132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.506883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a8a8b-abb7-49df-86bd-6c742b241c4e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.544274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.544716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.545000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.545275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.546081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.546389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.547833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.555801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:16.562984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 453/909] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:16.573470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.599828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:16.643388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cb49c-677d-4af0-a79b-862baeac3bbf None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.687912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.689024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.689492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.690406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.692023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] RBAC: Adding query filter params (interface=public, service_id=dbe4b91eaaf5429088a19d4c779f0f65, region_id=RegionOne) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.692569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.695201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.709665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 457/910] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/endpoints?service_id=dbe4b91eaaf5429088a19d4c779f0f65&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:16.711484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:16.729090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39f72-dabc-43c8-916b-8a22a4f1701c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.797581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.799134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.799486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.799930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.801691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] RBAC: Adding query filter params (role.id=86b5f419b163483e8b08e2daba6a466b, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=25c81a07126a425e9f4b7abfccaddab9) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:16.802031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.803807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5650053-dee2-47e3-891b-0e8cc0e81ece None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.815496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 454/911] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/role_assignments?user.id=25c81a07126a425e9f4b7abfccaddab9&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=86b5f419b163483e8b08e2daba6a466b => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:16.903361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef94268-a70b-48c2-8aba-39501ac3eada None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:16.967396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:16.968580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:16.969072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:16.969564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:16.970808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:16.973510 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40ba4-6e4f-41ca-9fa5-8d64a1731ea7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:16.975460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:16.989074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 458/912] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:16 2022] GET /identity/v3/services => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:34:17.904154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9023b-700c-4f10-90c7-f41b19c3207f None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:17.905236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9023b-700c-4f10-90c7-f41b19c3207f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:17.905741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9023b-700c-4f10-90c7-f41b19c3207f None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:17.907781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 455/913] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:17.913975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a43-6961-48fa-bd7b-8503a733daac None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:17.914971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a43-6961-48fa-bd7b-8503a733daac None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:17.915483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b0a43-6961-48fa-bd7b-8503a733daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:17.936006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fb0b0a43-6961-48fa-bd7b-8503a733daac None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:17.937731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fb0b0a43-6961-48fa-bd7b-8503a733daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:18.044935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 459/914] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:18.068761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9023b-700c-4f10-90c7-f41b19c3207f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.104177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2e8a-14e2-487d-8f72-c58da24b7c16 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.104521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2e8a-14e2-487d-8f72-c58da24b7c16 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.104741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd2e8a-14e2-487d-8f72-c58da24b7c16 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.106256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 460/915] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:18.122755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.123231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.123718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.138037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:18.163068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:18.164293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:18.194341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9023b-700c-4f10-90c7-f41b19c3207f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.253226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.255612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.256077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.256536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.258208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.259646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 461/916] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:18.260767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:18.274439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:18.275475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 28 17:34:18.276268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.278750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 456/917] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:18.287120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.302942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.362812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:18.439498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d26ab-c31c-4d9e-9489-2008dbfe885a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.456647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af80b-59d7-4dcf-9077-86070cafb87f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.494750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.495882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.496328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.496682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.497955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:18.498482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.498749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:18.501133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.511744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.512003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 462/918] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:18.515350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.515691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.516027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.518144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.518601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.520193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:18.536600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:18.537658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:18.538489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:18.539224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 457/919] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:18.549369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.658465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5247-76d1-4ee4-bccf-39aaacdb51d4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.685600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:18.700890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.701579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.701861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.702170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.702895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:18.703204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.703844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca6938-5eac-490b-b878-4bd24e374ed4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.704612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.715789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 463/920] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:18.716766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.742812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.743852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.744370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.744928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.745844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:18.746374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.748150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.754301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 458/921] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:18.764422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:18.831357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c0c0f-8635-4395-ba1f-746c0dd8415e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.838148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:18.873088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.874141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.874567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.875004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.875915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.877568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.890835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10999d7-76b8-44fd-9e66-892c8ce87af8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:18.911129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 464/922] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:18.938814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:18.939560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:18.939799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:18.940038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:18.940824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:18.941368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:18.943242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c7a1b-6e99-4724-9cdc-084c3f3e27d3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:18.949777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 459/923] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:18.955675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.013885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.027978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b22c-43e5-462b-a300-f25284577e2d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.028214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b22c-43e5-462b-a300-f25284577e2d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.028441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0b22c-43e5-462b-a300-f25284577e2d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.031418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 460/924] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:19.036267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.036605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.036823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.056662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:19.058035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:19.088072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e755d4-b0d7-49e3-9612-b25722ff8a07 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.131467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.131841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.132093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.132371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.133193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] RBAC: Adding query filter params (interface=public, service_id=156179bef4554452bc94228606308b20, region_id=RegionOne) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:19.133512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.135900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.145844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 465/925] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:34:18 2022] GET /identity/v3/endpoints?service_id=156179bef4554452bc94228606308b20&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:19.151396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.191215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 461/926] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:19.214462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.291563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.301117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10040-6710-452e-b52c-f4ae2a160a3e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.314365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.346541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.347737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.348028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.348305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.349004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.350446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d289c48-0792-4fb5-9e83-8eb56ac8fe21 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.357296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 466/927] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:34:19.358780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b20-81a2-48fe-9e00-27df64263085 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.359075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b20-81a2-48fe-9e00-27df64263085 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.359353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68670b20-81a2-48fe-9e00-27df64263085 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.360876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 467/928] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:19.367235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.367525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.367812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.381136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0844d-5f30-4df5-8875-e8ca9fee4f0e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.386924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:19.388180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:19.426499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.427774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.428377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.428832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.445386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:19.456753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:19.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:19.458856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:19.459487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 462/929] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:19.465355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.483639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 468/930] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:19.507788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.597707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da668396-7449-4f36-992f-0da44ad3765d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.601026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.634946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06248c4-4dff-41e8-bedf-e8731d564c18 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.637308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.647923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.648743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.649028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.649308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.650115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:19.650431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.652638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.665015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 463/931] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:19.670754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.687310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.688282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.688568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.688850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.689543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.693993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:19.708600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:19.709700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 28 17:34:19.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:19.718157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 469/932] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:19.719771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.805349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d87e5-dece-42fa-91ae-c848fa4dc333 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.840799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0b7f-71ee-43d1-b7b5-2e40743be29c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:19.842937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.843739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.844868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.844868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.856933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.858566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:19.878788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:19.879766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:19.880932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:19.880932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:19.880932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:19.880932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:19.880932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 464/933] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:19.885559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:19.886301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:19.886583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:19.886859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:19.887581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:19.887840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.887964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:19.889387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:19.900140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 470/934] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:19.902471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:19.916857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:19.941210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:20.018284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e107ff6-d0b7-44f7-be20-62a65c698c9f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.036042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc69d7-f8ea-44a5-8ea0-4c0dabeb2e6f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.056671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.057065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.057353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.057632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.058390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:20.058700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.060088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.073967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 465/935] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:20.079072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:20.093200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.094351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.094822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.095282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.096238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:20.096808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.098891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.105021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 471/936] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:20.111332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:20.177898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:20.221096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf3a03-4ac4-4bd5-9560-999712b99b36 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.252589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:20.267312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f1bef-317e-411d-ad0a-3b78798f5c77 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.286027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.287611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.288072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.288600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.305663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.308600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.315404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.316461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.316931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.317459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.318438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.320015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:20.341465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:20.342516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:20.343490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:20.344721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 466/937] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:34:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:20.350119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 472/938] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:20.352857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:20.489222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf5cb6-57e9-440b-9c7b-1964264d3d7a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.537892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.539017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.539520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.540004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.541088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:20.541621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.543347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.545617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:20.568352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 467/939] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:34:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:20.576750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:20.761593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5e94-a595-439a-a015-eb21507db7eb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:20.824166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:20.825457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:20.825934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:20.826377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:20.846435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:20.849178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:20.864422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:20.883968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:20.885427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:20.886341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:20.886341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:20.886341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:20.886341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:20.888885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 473/940] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:20.897601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.073992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e17a-5831-407f-b56d-ea5cc00be417 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:21.117354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:21.118479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.118963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.119430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.120375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:21.120917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:21.122577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:21.136966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 468/941] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:21.146413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.285805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d33427-3c47-45d0-8a1b-be2c2347804a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:21.323635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:21.324455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.324734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.325005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.332822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:21.334316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-3baadb9b-5a01-4256-9604-2b5e26135ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:21.349504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:21.351182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.352812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 474/942] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:21.363847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.397086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729900e-6d93-445f-98b3-73e5e583d511 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.397319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729900e-6d93-445f-98b3-73e5e583d511 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.397664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729900e-6d93-445f-98b3-73e5e583d511 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.399269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 475/943] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:21.406073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.406362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.406644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.432918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:21.435355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:21.461091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:21.525843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d58fdd-5915-4f19-aedb-9e7d9b3db55d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:21.558203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:21.580378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:21.582069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 476/944] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:21.582478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.583327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.584057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.585751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:21.586600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:21.589532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:21.599587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.619862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 469/945] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:21.632493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.794631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85168f0a-7a23-4eed-b9e8-fe5fbfdbe191 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:21.806767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edab4f-0098-4186-bff4-87a232336c62 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:21.838383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:21.847276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:21.848400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.848746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.849090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.850038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:21.851854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:21.853340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING keystone.server.flask.common [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 28 17:34:21.874813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.sql.core [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 17:34:21.874813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 17:34:21.874813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [parameters: {'id': '89a3970080be4efca57701e853630f2f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 17:34:21.874813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 17:34:21.884682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89a3970080be4efca57701e853630f2f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89a3970080be4efca57701e853630f2f. Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:34:21.885449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 28 17:34:21.886249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application yield resource Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise self.value Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application session.commit() Jun 28 17:34:21.887175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.flush() Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application compat.raise_( Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 17:34:21.888033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 17:34:21.888901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:34:21.889662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [parameters: {'id': '89a3970080be4efca57701e853630f2f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:21.892191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:21.893732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89a3970080be4efca57701e853630f2f. Jun 28 17:34:21.902885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:21.904037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:21.904037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:21.904037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/25c81a07126a425e9f4b7abfccaddab9/roles/86b5f419b163483e8b08e2daba6a466b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:21.904037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=25c81a07126a425e9f4b7abfccaddab9, role_id=86b5f419b163483e8b08e2daba6a466b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:21.904559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 477/946] 10.222.0.48 () {60 vars in 1140 bytes} [Tue Jun 28 17:34:21 2022] POST /identity/v3/projects => generated 262 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:21.904693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b40f93-1056-4271-9a09-06b91193d1d9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:21.904826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:21.925778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 470/947] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:21 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/25c81a07126a425e9f4b7abfccaddab9/roles/86b5f419b163483e8b08e2daba6a466b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:34:21.961974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:22.039498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281ef1b-9020-481c-a700-835ba6a5b22c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:22.081438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:22.082774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.083061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.083336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.091525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:22.093246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:22.107235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a814d9-b356-4ebc-ba9b-5a244db4b479 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.107921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a814d9-b356-4ebc-ba9b-5a244db4b479 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.107921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a814d9-b356-4ebc-ba9b-5a244db4b479 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:22.109709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:22.111678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:22.114476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:22.115448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 471/948] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:22.115599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 478/949] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:22.117022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.117022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.117022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.118497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:22.136116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:22.137759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:22.226581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 472/950] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:22.246301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6b9f6-e10e-40ae-acc3-eb0f0a1208c0 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:22.252441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:22.260524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:22.302694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:22.303968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.304465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.304937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.306112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:22.306736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:22.309165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:22.335287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 479/951] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:22.421576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de64ab-29f9-4bf8-bfef-bb77ad119353 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:22.424309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:22.468983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:22.470251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.470792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.471304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.472589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:22.475122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:22.490388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:22.491949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:22.492954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:22.496419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 473/952] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:22.504356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:22.632666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d297a7-4551-4b80-83ef-714924a4c940 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:22.675420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:22.677083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.677440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.677728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.678654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:22.679107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:22.680646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:22.688398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 480/953] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:22.694186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:22.806821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261514-1a3a-4556-a5ad-aad519f26301 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:22.843551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:22.844245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:22.844527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:22.844801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:22.845532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:22.845836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:22.847322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1063d-bf3e-47f9-9eb6-de2b3db9fcee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:22.853452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 474/954] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:22.859386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:22.899986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:22.987662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86c5bf-e8e4-4bcb-82a5-f3ef4d7a1c30 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:23.024464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32655c-9e8c-4e13-a873-8e2a474c314e None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.024845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32655c-9e8c-4e13-a873-8e2a474c314e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.025009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32655c-9e8c-4e13-a873-8e2a474c314e None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.027014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 475/955] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:23.032739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.033077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.033295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.033995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:23.034771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.035052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.035324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.036109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:23.037625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:23.053266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:23.054577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:23.064949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 481/956] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:23.089353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:23.158619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 476/957] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:23.182700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:23.310129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:23.333495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7483-e398-40fc-bfaf-798710231ff2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:23.384274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:23.386075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.386770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.387523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.389087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:23.391832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:23.418418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:23.420358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:23.421700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:23.429010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 482/958] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:23.434527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:23.615477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0385de-7033-4a7b-9372-15a9167c7199 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:23.671251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:23.672010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.672316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.672645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.674004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:23.674375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:23.676615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1c8cf-23c8-44a4-996d-337f30adcb5e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:23.684118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 477/959] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:23.691376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:23.833664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb9cdd-1999-46e1-aa1e-065cecab5874 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:23.874042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:23.874739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:23.875020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:23.875295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:23.876013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] RBAC: Adding query filter params (type=compute) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:23.876320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:23.877742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c63e1-7c15-41f9-b26e-ad03ca6a4bae None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:23.884202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 483/960] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:24.656542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e75a-de44-44e4-a471-265f9ecddf20 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:24.657080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e75a-de44-44e4-a471-265f9ecddf20 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:24.657080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412e75a-de44-44e4-a471-265f9ecddf20 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:24.658890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 478/961] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:24.664654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:24.665134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:24.665208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:24.684455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:24.685991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:24.697150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:24.771224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 484/962] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:24.790865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412e75a-de44-44e4-a471-265f9ecddf20 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:24.815130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:24.897708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412e75a-de44-44e4-a471-265f9ecddf20 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:24.933304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:24.934172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:24.934455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:24.934727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:24.945519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:24.953695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:24.954630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:24.955860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 479/963] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:24.961862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.149318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd29a44-1c41-4d99-b323-320623cba111 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.213288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:25.214422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.214927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.215428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.216873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:25.217435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:25.220136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9eb8b-a576-4e6b-b901-c131892ce31b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:25.237530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 485/964] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:25.243414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.289701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762437f6-50bb-4d91-a5a7-15d406ec7598 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.290383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762437f6-50bb-4d91-a5a7-15d406ec7598 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.290680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762437f6-50bb-4d91-a5a7-15d406ec7598 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.293596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 486/965] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:25.302532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e1b82-2603-474f-8a5b-0cad51903e85 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.303282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e1b82-2603-474f-8a5b-0cad51903e85 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.303554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e1b82-2603-474f-8a5b-0cad51903e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.323747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:25.332888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-248e1b82-2603-474f-8a5b-0cad51903e85 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:25.336007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-248e1b82-2603-474f-8a5b-0cad51903e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:25.337394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:25.357745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f19d2-fda5-435d-907e-12e25aaf6cb0 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.395321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:25.396426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.396961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.397439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.409391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:25.411467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:25.431576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:25.432505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:25.433503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:25.433503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:25.433503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:25.433503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:25.440402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 480/966] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:25.441816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.468350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 487/967] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:25.483782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ce514-aa9a-43ae-ad9c-b8023166ae83 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.484059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ce514-aa9a-43ae-ad9c-b8023166ae83 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.484341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ce514-aa9a-43ae-ad9c-b8023166ae83 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.490460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 488/968] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:25.492012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.492304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.492580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.511959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:25.513185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:25.594071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 489/969] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:25.594071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.595024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a8b96-bc10-4c07-9e84-63246aeb2ca6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.651924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:25.657391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:25.658245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.658846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.659441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.660232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:25.660610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:25.662234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:25.675015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:25.676756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 481/970] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:25.677654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.728802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006317db-b2e1-4d9d-b6e6-b223fe836b28 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.770247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:25.771440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.771955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.772457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.773795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:25.776938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:25.800723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.sql.core [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 17:34:25.800723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 17:34:25.800723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [parameters: {'user_id': 'cf993f4936144d4387cb3f1e24dab0f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 17:34:25.800723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 28 17:34:25.807675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b4ce0-1c4f-48da-b836-d70c489dadda None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:34:25.818444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:34:25.819452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application yield resource Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application next(self.gen) Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.rollback() Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.force_reraise() Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise self.value Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application session.commit() Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 28 17:34:25.820388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._prepare_impl() Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.session.flush() Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._flush(objects) Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application compat.raise_( Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application flush_context.execute() Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rec.execute(self) Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 28 17:34:25.821512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 28 17:34:25.822405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result = self._query(query) Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application conn.query(q) Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application result.read() Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 28 17:34:25.825058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cf993f4936144d4387cb3f1e24dab0f3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:25.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 28 17:34:25.828326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 490/971] 10.222.0.48 () {60 vars in 1131 bytes} [Tue Jun 28 17:34:25 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:25.829907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.864226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:25.865816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:25.866482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:25.867054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:25.868409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:25.871182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:25.895431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:25.896517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:25.897396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:25.898506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 482/972] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:25.900069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:25.942756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965902dd-3a97-4d91-b64c-56171d9d62a5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:25.983886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:25.992202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.006984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.008474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.008474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.008474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.016832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.018859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:26.034262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:26.035641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 491/973] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:34:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:26.036609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.069410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65df8-e124-4ef9-9dd6-a7a85f8473f5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.113148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.114006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.114299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.114561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.123631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.125318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:26.141305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:26.142972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 28 17:34:26.144383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:26.147556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 483/974] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:26.148530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.196460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638993-00b3-462c-b896-f7a9d3fe3578 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.248081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.249153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.249659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.250188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.251559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:26.252110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.255247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.275978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 492/975] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:26.275978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.287065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f8b0-efa1-409a-aefa-36704785176c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.310133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.335232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.335926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.336210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.336456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.337320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:26.337777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.339173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.368516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 484/976] 10.222.0.48 () {56 vars in 1149 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:26.368516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.375138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.434722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef07ef-b939-4912-8310-2211bc7ecdd2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.482428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.483324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.483793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.484204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.485381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:26.485705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.487466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.503589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b742c8-ac34-4f9b-8c09-5cd564d65d70 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.530062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 493/977] 10.222.0.48 () {56 vars in 1101 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:26.531431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.561244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.562514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.563017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.563508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.564867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:26.565389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.567977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4171-1f8c-4373-9d24-58c96169e663 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.583444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 485/978] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:26.583444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4008c-9c34-4e83-9324-9bf416effba0 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.583444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4008c-9c34-4e83-9324-9bf416effba0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.583444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4008c-9c34-4e83-9324-9bf416effba0 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.583444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 486/979] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:26.585283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.585588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.585861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.611303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:26.613825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:26.675745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.713275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35faaa4-6f99-4ff0-8412-ba3cb3d62abe None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.729521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.762090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 487/980] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:26.762090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.775869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.776838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.777328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.777813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.884239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.885717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.900220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad1ddc-a02e-4a61-bb2f-8ce927d3dd51 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:26.943106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:26.943781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:26.944044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:26.944332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:26.945136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] RBAC: Adding query filter params (interface=admin, service_id=156179bef4554452bc94228606308b20, region_id=RegionOne) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:26.945434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:26.946859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:26.952285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 488/981] 10.222.0.48 () {56 vars in 1249 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/endpoints?service_id=156179bef4554452bc94228606308b20&interface=admin®ion_id=RegionOne => generated 193 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:26.953084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:26.988457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:26.994292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 494/982] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:26.995161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:27.008851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:27.074696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74b41f-0eef-4e53-a956-d6a1d3a13c0d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:27.108233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ebce-a10b-4380-a43f-358be7b98b6f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:27.110845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:27.111520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:27.111795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:27.112069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:27.112825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:27.114245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:27.128728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 489/983] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:26 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:27.129863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:27.170012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:27.170012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:27.170012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:27.170012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:27.170484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:27.170484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:27.179607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 495/984] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:26 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:34:27.285392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:27.301501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c66c9b-9ada-4a3a-ae74-ebdb8a7f54e3 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:27.354273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:27.355256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:27.355549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:27.355847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:27.373271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:27.374797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:27.395146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:27.396763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:27.398534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:27.398534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:27.398534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:27.398534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:27.398534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 490/985] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:27.405566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:27.492548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:27.543647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01e606-e448-4449-bfa0-ee54a475589e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:27.585879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:27.586588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:27.586872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:27.587150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:27.587894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:27.588204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:27.589641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:27.603470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 496/986] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:27.609107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:27.727058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487a83-0715-460c-b66b-5b767495360a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:27.771868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:27.772782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:27.773125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:27.773402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:27.782626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:27.784081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:27.799272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:27.800574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:27.801572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 491/987] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:27.810523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:27.979618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61076fb-564a-4208-807f-279c73b001a2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:28.031045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:28.042704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:28.043740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:28.044168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:28.044587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:28.045919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:28.046427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:28.049213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468883f-69d9-4604-bfe0-63044a87de93 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:28.071719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 497/988] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:28.080735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:28.087975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:28.226709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98012218-4658-49cd-9aa8-eeb7bcf79c84 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:28.267591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:28.268516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:28.268935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:28.269469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:28.270482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] RBAC: Adding query filter params (role.id=86b5f419b163483e8b08e2daba6a466b, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=25c81a07126a425e9f4b7abfccaddab9) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:28.270930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:28.272544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be440d37-f3be-485d-b685-3b80dc51909f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:28.279534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 492/989] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:28 2022] GET /identity/v3/role_assignments?user.id=25c81a07126a425e9f4b7abfccaddab9&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=86b5f419b163483e8b08e2daba6a466b => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:29.326383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351d71-eb54-4af5-ad52-f21e3a2d9543 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.326943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351d71-eb54-4af5-ad52-f21e3a2d9543 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.326943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351d71-eb54-4af5-ad52-f21e3a2d9543 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.328298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 498/990] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:29.334417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8adbe3-5cca-4cdf-8f8e-d8947344ff73 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.335084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8adbe3-5cca-4cdf-8f8e-d8947344ff73 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.335084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8adbe3-5cca-4cdf-8f8e-d8947344ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.352494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2d8adbe3-5cca-4cdf-8f8e-d8947344ff73 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:29.353686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2d8adbe3-5cca-4cdf-8f8e-d8947344ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:29.422810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:29.438111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 493/991] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:29.454532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351d71-eb54-4af5-ad52-f21e3a2d9543 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:29.507940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891101-89c2-4090-90cf-441b90be2be3 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.508206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891101-89c2-4090-90cf-441b90be2be3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.508484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891101-89c2-4090-90cf-441b90be2be3 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.509865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 494/992] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:29.515885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.516172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.516452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.535598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:29.536917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:29.590402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351d71-eb54-4af5-ad52-f21e3a2d9543 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:29.615963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 495/993] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:29.631170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:29.632329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.632791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.633230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.634105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:29.635731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:29.639018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:29.651890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:29.652935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:29.654032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 499/994] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Jun 28 17:34:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:29.659275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:29.734776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:29.792046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea069-80aa-4c86-9dd9-ad741b6e0fd6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:29.795401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34376dc7-d79a-469f-b393-36661c8d837c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:29.833796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:29.834529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.835381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.835381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.835635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:29.835858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:29.836117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:29.837571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:29.843842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 500/995] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:29.849618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:29.849881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:29.850905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:29.851342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:29.851751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:29.852785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:29.854955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:29.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:29.871911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:29.872846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:29.874720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 496/996] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:29.879194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:29.992582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e01082-ae4b-4dfc-8ee4-9ce64cb9e06a None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.018310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df99a52-fac2-4ec3-ad01-927c681d46ea None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.022319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:30.052547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.053606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.054089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.054522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.055600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:30.056105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.058671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.073999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 501/997] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Jun 28 17:34:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:30.074228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.074228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.074228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.074228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.074865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:30.075344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.075950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:30.077651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.085835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 497/998] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:30.092110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:30.181672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:30.236701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee62970-80d8-4389-90ee-1ea49b94c794 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.251870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a96039-71ab-4171-9926-691ef8a208b9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.283133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.283836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.284113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.284391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.285278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.286744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.297531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.298941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.299360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.299761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.302427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] RBAC: Adding query filter params (type=compute) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:30.302883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.304761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.308891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 502/999] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:30.317001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 498/1000] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:30.319204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:30.379240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:30.479560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa83c3-b9f1-4cb6-b857-26926f29e1ac None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.522729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.523415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.523697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.523975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.524789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] RBAC: Adding query filter params (interface=public, service_id=f9cb38211a7b4d36a5100d94439bb2e4, region_id=RegionOne) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:30.525099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.526549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5cdca-8cde-44a5-99a2-5f74ff6f1600 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.533474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 503/1001] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:34:30 2022] GET /identity/v3/endpoints?service_id=f9cb38211a7b4d36a5100d94439bb2e4&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:30.542837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:30.543902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65d29-c229-4d99-9ccb-ecf52f65b555 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.544196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65d29-c229-4d99-9ccb-ecf52f65b555 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.544481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c65d29-c229-4d99-9ccb-ecf52f65b555 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.545860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 504/1002] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:30.551737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.552131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.552295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.570946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:30.572507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:30.660224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 505/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:30.680459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99f80e-920e-4f15-9dbf-b909f7ccbd5e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.684057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:30.706913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:30.726083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:30.729315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.730163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.730346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.730609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.731486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.733829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.741128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 499/1004] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:30 2022] GET /identity/v3/services => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:34:30.866116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaabf8-f820-4c42-b347-3de2ce22e0e9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:30.909404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:30.910785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:30.911070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:30.911353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] PATH_INFO: `/v3/services/image` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:30.912035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:30.913468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:30.926865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:30.929295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:30.931514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 506/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Jun 28 17:34:30 2022] GET /identity/v3/services/image => generated 86 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:30.937578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:31.100388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5956f-e320-4f75-adbd-7d3f60b2dd2d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:31.136321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:31.137011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:31.137288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:31.137559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:31.138308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] RBAC: Adding query filter params (name=image) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:31.138614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:31.139999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a546dee-4f4c-45c5-9cc6-e54996052505 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:31.146417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 500/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:31.152306 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:31.311370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:31.320182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761bb1b-aa65-4f40-96b8-e526131df642 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:31.378215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:31.379697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:31.381163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:31.381651 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:31.382587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] RBAC: Adding query filter params (type=image) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:31.383003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:31.384527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86877f-0a74-4413-963f-93c1d5eaf587 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:31.398361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 507/1007] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:32.447082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a6a3-7792-4836-bf9c-1ee6ef4f2f67 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:32.447674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a6a3-7792-4836-bf9c-1ee6ef4f2f67 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:32.447674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126a6a3-7792-4836-bf9c-1ee6ef4f2f67 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:32.449173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 501/1008] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:32.454701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:32.455191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:32.455298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:32.474273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:32.475497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:32.558863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 508/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:32.583296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126a6a3-7792-4836-bf9c-1ee6ef4f2f67 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:32.641592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:32.723575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126a6a3-7792-4836-bf9c-1ee6ef4f2f67 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:32.775596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:32.776260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:32.776541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:32.776816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:32.778278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:32.779747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597c10a-6a16-4e7a-9729-928c80502ee4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:32.781643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 502/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:32.787888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:32.897358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:32.915105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f22c8-377a-4918-9974-83a923ef99c0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:32.973100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:32.974291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:32.974697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:32.975130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:32.976298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:32.978801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebca9d6-142e-4111-a1b8-b4319724fa30 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:33.022036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 509/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:32 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:33.026675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e478-ddce-41ad-af09-311d1b3e039b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.027053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e478-ddce-41ad-af09-311d1b3e039b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.027507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3e478-ddce-41ad-af09-311d1b3e039b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.029601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 503/1012] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:33.036604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.036904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.037163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.057064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:33.058385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:33.137426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 510/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:33.162501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e478-ddce-41ad-af09-311d1b3e039b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:33.302862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3e478-ddce-41ad-af09-311d1b3e039b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:33.321178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:33.342109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:33.342933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.343210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.343482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.344141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:33.345711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:33.358783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:33.359883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:33.360914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 504/1014] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:33.369689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:33.450878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:33.486251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4b90a-f6e4-4453-8d2f-c79ac84a2492 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:33.526418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:33.527106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.527387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.527662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.528501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:33.529012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:33.531075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:33.545265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 511/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:33.546697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:33.684872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3775c410-c630-4703-80dd-fdec7e3efbe7 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:33.742463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:33.743479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.743934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.744411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.745677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:33.746264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:33.748854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace4e4f-38a1-4141-975f-73ed8aa0d26a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:33.762050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 505/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Tue Jun 28 17:34:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:33.769932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:33.940995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eb0f5-16b6-43d7-9a0a-1f56e532648f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:33.951376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dfc1-d881-497b-b7ac-7450f1cde863 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.951653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dfc1-d881-497b-b7ac-7450f1cde863 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.951921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dfc1-d881-497b-b7ac-7450f1cde863 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.953540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 506/1017] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:33.959359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ba6b-5549-4b5f-9055-e4fa39b03245 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:33.959626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ba6b-5549-4b5f-9055-e4fa39b03245 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:33.960043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ba6b-5549-4b5f-9055-e4fa39b03245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:33.977619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8524ba6b-5549-4b5f-9055-e4fa39b03245 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:33.978887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8524ba6b-5549-4b5f-9055-e4fa39b03245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:34.002536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:34.003221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:34.003578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:34.003907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:34.004642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:34.006072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:34.010643 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:34.036261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 512/1018] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:34.040406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:34.085986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 507/1019] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:33 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:34.113285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:34.287259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8e516-395e-4657-ab00-3c1434eafd24 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:34.345869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:34.346624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:34.346908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:34.347238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:34.348040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:34.349630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c2cc-3c6b-4e6c-b654-0b43fd6f4396 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:34.374720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 513/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:34:34 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:34:35.232520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2bb3-a4dc-4c15-a8eb-c34f9b5aadcd None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:35.233262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2bb3-a4dc-4c15-a8eb-c34f9b5aadcd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:35.233262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc2bb3-a4dc-4c15-a8eb-c34f9b5aadcd None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:35.234731 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 508/1021] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:35.240694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:35.241210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:35.241286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:35.260197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:35.261456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:35.333754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:35.381007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 514/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:35.424826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2bb3-a4dc-4c15-a8eb-c34f9b5aadcd None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:35.615569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc2bb3-a4dc-4c15-a8eb-c34f9b5aadcd None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:35.685483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:35.686950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:35.687446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:35.687941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:35.690332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:35.694042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c02df-8aa4-4441-be70-93faf836f378 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:35.697473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 509/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:35.706851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:35.881242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7772f-6eab-402b-9d79-38943cafa09b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:35.922859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:35.923902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:35.924187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:35.924464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:35.925209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:35.926801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1081e-4e48-47ea-b127-013397f06533 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:35.951382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 515/1024] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:34:35 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:34:36.411527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fa34-8d45-498a-a21a-a7dd2d123ee4 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:36.412071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fa34-8d45-498a-a21a-a7dd2d123ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:36.412071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9fa34-8d45-498a-a21a-a7dd2d123ee4 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:36.413477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 510/1025] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:36.419522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:36.420051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:36.420051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:36.438710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:36.439907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:36.471503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:36.521089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 516/1026] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:36.544584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9fa34-8d45-498a-a21a-a7dd2d123ee4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:36.591985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:36.663243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9fa34-8d45-498a-a21a-a7dd2d123ee4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:36.699936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:36.700842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:36.701079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:36.701334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:36.713159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:36.721341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:36.722977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:36.723807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 511/1027] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:36.730834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:36.853570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72353122-add8-4cfb-9623-6067c54d15e8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:36.888956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:36.889635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:36.889913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:36.890213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:36.890958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:36.891261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:36.892641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:36.902708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 517/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:36.908466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.020697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.025341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca42aae-c6ae-4e6f-8e5b-67c7750bd211 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.063793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.064611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.064888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.065167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.077987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.079441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-cc80cfa7-a6f9-4098-bfa6-2b8a1c612c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:37.099511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:37.106939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:37.108702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:37.108702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:37.108702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:37.108702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:37.108702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 512/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:37.114230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.151118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.153163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91662-d24d-4ad7-b967-b5a11571f4f0 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.153493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91662-d24d-4ad7-b967-b5a11571f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.153778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b91662-d24d-4ad7-b967-b5a11571f4f0 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.155751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 513/1030] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:37.161916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.162227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.162497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.182212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:37.183083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:37.242095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2897243-8e82-49bc-a3cc-69aff15a525c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.271156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 514/1031] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:37.281695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.282473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.282758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.283035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.283779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:37.284114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.285536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.294322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.298981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 518/1032] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:37.304751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.393807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.401004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.418154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c1f4b-5db0-404e-b5a5-4619b24d28ef None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.421734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4973be-321c-40ca-bbbd-7f1af3810813 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.457518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.458377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.458659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.458932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.463997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.464843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.465125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.465400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.466107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.467496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.469458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.470945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:37.481280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:37.482360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:37.483166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:37.486301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 515/1033] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:37.486746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:37.487780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:37.488810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 519/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:37.491114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.494259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.610505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee66c7-feb4-4f29-b1ce-13dfb99ad6c5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.614082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d2d1-d16a-481d-a41b-a63acb062cb7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.648806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.649503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.649828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.650043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.650751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] RBAC: Adding query filter params (name=image) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:37.651052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.652430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.653299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.654141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.654541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.654822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.655689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:37.655988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.657441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.658369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 516/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:37.663968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.677491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.693493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 520/1036] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:37.695750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.702516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.795060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271954b7-491b-4985-a46e-9ca721effb83 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.842944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c930-87fe-4fa9-8b4a-7c5a8ea7413f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.843868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.846195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.846195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.846195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.846195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:37.846195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:37.849551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:37.860438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 517/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:37.861522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:37.891505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600680d-430b-4828-906c-22066ed7445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:37.892601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600680d-430b-4828-906c-22066ed7445f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:37.893141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600680d-430b-4828-906c-22066ed7445f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:37.893432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600680d-430b-4828-906c-22066ed7445f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:37.941084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:37.977252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd8077-3446-4400-bec4-a7530b61aac9 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:37.998426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600680d-430b-4828-906c-22066ed7445f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.000264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600680d-430b-4828-906c-22066ed7445f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.003918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.033163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.033846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.034157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.034452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.035470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] RBAC: Adding query filter params (interface=public, service_id=87891f0cfb7542009e4cfcc8c7544cd4, region_id=RegionOne) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:38.035785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.037181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.042888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 518/1038] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/endpoints?service_id=87891f0cfb7542009e4cfcc8c7544cd4&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:38.049229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.128292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 521/1039] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:38.129932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51f7f-2440-4775-add3-f0075e5a4de5 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.129932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51f7f-2440-4775-add3-f0075e5a4de5 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.129932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e51f7f-2440-4775-add3-f0075e5a4de5 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.135858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 522/1040] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:38.135858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e51f7f-2440-4775-add3-f0075e5a4de5 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.178929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df464e-f4c2-43a8-86e9-7fef47be7775 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.220255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.220934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.221219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.221498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.222307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.223727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd23988-89af-472a-bc4c-2b2eeae0e785 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.225724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.231569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 519/1041] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/services => generated 1957 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:34:38.234658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.235474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.235916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.265959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:38.267237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:38.269761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e51f7f-2440-4775-add3-f0075e5a4de5 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.273687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.322811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.323720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.323931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.324225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.336933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.338514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:38.364473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:38.366364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:38.368162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:38.368162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:38.368162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:38.368162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:38.370213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 523/1042] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:38.372981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.384229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 520/1043] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:38.406508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.516802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b08d65-d091-42d1-9d3a-e6691fa47deb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.552633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370802c-2b16-4a14-92db-13dfd4f6bdf2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.566972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.567706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.568079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.568411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.569253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:38.569568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.571032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.584980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 524/1044] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:38.586983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.591254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.593501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.594967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.595323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.595603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.609800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:38.615459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:38.619042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:38.620176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:38.622991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 521/1045] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:38.627494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.734782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82e7c7-cfe9-4af7-8b2e-ae3b293b6a1b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.777444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4ed7-8ae3-42b6-b4a9-9c9db684c9c8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.784303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.785493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.785782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.786163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.796537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.799149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.824948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:38.825325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:38.826638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:38.834798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:38.835438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.835438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.835438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.835438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:38.835701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 525/1046] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:38.835769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:38.835769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:38.837832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.843337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 522/1047] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:38.851737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:38.924755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.945914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:38.952201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3dad6-8d26-44d9-b82b-20832fbca4c5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:38.997768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:38.998276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:38.999374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:38.999374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:38.999725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:39.000036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.001498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.012703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9209-7a6d-431a-a67d-16775bb8f8fe None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:39.020383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 526/1048] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:39.022754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:39.061523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:39.062472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:39.062750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:39.063015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] PATH_INFO: `/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:39.079622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a5d5a3260b4fb3ba99a36571b2ed7b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.081210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.083713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 523/1049] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:38 2022] GET /identity/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b => generated 285 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:39.089375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:39.150084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea0e-ce79-4436-a3a1-73c8b4e1f8fc None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:39.191048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:39.192048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:39.192384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:39.192652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:39.193502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] RBAC: Adding query filter params (role.id=86b5f419b163483e8b08e2daba6a466b, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:39.193816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.195331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.198705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:39.204258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024001a-fa97-4b29-9a9b-962641b7ea48 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:39.214489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 527/1050] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:39 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=86b5f419b163483e8b08e2daba6a466b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:39.227062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:39.256820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:39.257413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:39.257692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:39.258005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:39.351300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.352813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.527578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 524/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 17:34:39.529056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:39.662153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbd606-22cb-4513-901e-d75e00344aac None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:39.706006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:39.707147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:39.707451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:39.707852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:39.709115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.710633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdbe14-5263-40e2-9b4c-5bb978ac885d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.717434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 528/1052] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:39 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:39.722293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:39.735116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:39.883692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39ffa-c337-4965-bf07-df62f71b6d2a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:39.934058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:39.934740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:39.935017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:39.935291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:39.936178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=ed2cf543655642049ac3b851c69e0927, user.id=a4a5d5a3260b4fb3ba99a36571b2ed7b) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:39.936493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:39.938409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b77bfe-ae4c-4893-9612-098f3406a071 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:39.945891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 525/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:39 2022] GET /identity/v3/role_assignments?user.id=a4a5d5a3260b4fb3ba99a36571b2ed7b&scope.project.id=ed2cf543655642049ac3b851c69e0927&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:40.376393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1d1f-1cd3-49fd-9233-1e59a62123da None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:40.376784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1d1f-1cd3-49fd-9233-1e59a62123da None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:40.376980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab1d1f-1cd3-49fd-9233-1e59a62123da None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:40.378331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 529/1054] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:40.384026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:40.384289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:40.384589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:40.402859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:40.404054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:40.475553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 526/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:40.498481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1d1f-1cd3-49fd-9233-1e59a62123da None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:40.574861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:40.615147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab1d1f-1cd3-49fd-9233-1e59a62123da None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:40.651417 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:40.652108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:40.652443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:40.652720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] PATH_INFO: `/v3/services/image` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:40.653423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:40.654844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:40.667034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:40.668023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:40.674496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 530/1056] 10.222.0.48 () {56 vars in 1105 bytes} [Tue Jun 28 17:34:40 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:40.675354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:40.678567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:40.788576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda3707-0f5b-47ec-86ce-0cca6d7c1518 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:40.826249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:40.826928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:40.827214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:40.827494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:40.828208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] RBAC: Adding query filter params (name=image) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:40.828515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:40.829905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:40.835670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 527/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:40.841328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:40.952624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e51fe-4726-4651-9137-a07f913a4bbb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:40.983924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:40.991649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:40.992344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:40.992632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:40.992902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:40.993616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] RBAC: Adding query filter params (type=image) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:40.993925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:40.995362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5645-32df-48cb-8b4c-d4ab9682a433 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:41.006157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 531/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:41.007752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:41.088202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:41.126143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a789bc-c750-4da7-8532-a366bf7e7492 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:41.163620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:41.164291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.164572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.164849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.165594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:41.167009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6dd0e-4e80-4e61-a591-2c60253f3f3c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:41.193994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 528/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:34:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:41.311753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a98-d592-4ca0-8a32-9ce4ec201d3c None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.311937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a98-d592-4ca0-8a32-9ce4ec201d3c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.312236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05138a98-d592-4ca0-8a32-9ce4ec201d3c None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.313726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 532/1060] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:41.320679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.321002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.321234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.339979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:41.341197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:41.437288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 529/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:41.464380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05138a98-d592-4ca0-8a32-9ce4ec201d3c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:41.576184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05138a98-d592-4ca0-8a32-9ce4ec201d3c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:41.614411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:41.615242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.615525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.615858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.627456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:41.635699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:41.636897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:41.638984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 533/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:41.643185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:41.700058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:41.765741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c1a8c-c16c-481a-8e7b-b26476a86ebb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:41.807525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:41.808206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.808465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.808743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.809496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:41.809804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:41.811251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7be67-6f79-40a9-a913-eff4fd86de7e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:41.822459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 530/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:41.828419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:41.893789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:41.942412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471d269-2347-42c4-9e12-21ddf0c977e9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:41.979389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:41.980201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.980482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.980757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.991736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea557-0d5b-42e3-aedb-998a7e830b60 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.991990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea557-0d5b-42e3-aedb-998a7e830b60 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.992266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ea557-0d5b-42e3-aedb-998a7e830b60 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:41.993641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 531/1064] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:41.995022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:41.996785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:41.998967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:41.999280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:41.999541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:42.016936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:42.018009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:42.018912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:42.018912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:42.018912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:42.018912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:42.019177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:42.019177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:42.022305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 534/1065] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:42.024513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.101802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 532/1066] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:42.124351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.143882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82cd0c-f8e5-4d5e-adb2-216865499073 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.157326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.174234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.189961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.191419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.192049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.192496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.193411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:42.193715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.195137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.211453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 535/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:42.217117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.240587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3148e6-b0cc-4f2a-8a78-e4fa493fa39b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.276704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.277502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.277785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.278097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.289057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:42.296753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:42.297690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:42.299209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 533/1068] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:42.304895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.329146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9826bb1-2224-4dd7-9913-04f61ca8bd81 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.367674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.368412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.368690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.368959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.376970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.378590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:42.394708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:42.395935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:42.396856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 536/1069] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:42.402520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.416304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a16b-e8f9-4b51-aa78-ee2a013b4f6c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.418931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.432882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.457176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.458011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.458293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.458567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.459318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:42.459623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.461033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.469989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 534/1070] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:42.475773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.519116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53509826-4282-443b-ba8f-814705cbb90d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.556411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.557466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.557853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.558164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.559021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:42.559333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.560775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.581428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 537/1071] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:42.587090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.594072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358361-88bb-4d1e-b3ad-b159bec69bdf None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.635854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.636660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.636940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.637212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] PATH_INFO: `/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.638450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] RBAC: Authorizing `identity:get_user(user_id=a4a5d5a3260b4fb3ba99a36571b2ed7b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.640024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.641695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 535/1072] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:42.647534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.683530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.684224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.704735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00ca83-a548-48b8-a80c-31f4a2c72833 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.749423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.750284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.750568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.750847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.764356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6da-6f84-4645-ad5d-791bbda4bb9b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.764578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.766042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:42.790873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:42.791821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:42.797676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:42.797676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:42.797676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:42.797676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:42.797676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 538/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:42.798227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.803018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.803904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.804186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.804462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.805649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.807139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.813800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 536/1074] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:42.814934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.906976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538247c-323f-4515-bcf8-7756082b2382 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.923281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.927340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9106828-3e5f-4486-a6f9-e7edeb110245 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:42.943821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.944797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.945081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.945361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.946134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:42.946441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.947843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.954606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:42.966911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 539/1075] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:42.968073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:42.970325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:42.971244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:42.971521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:42.972799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927/users/a4a5d5a3260b4fb3ba99a36571b2ed7b/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:42.974068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] RBAC: Authorizing `identity:create_grant(project_id=ed2cf543655642049ac3b851c69e0927, user_id=a4a5d5a3260b4fb3ba99a36571b2ed7b, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:42.975528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:42.990494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 537/1076] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:42 2022] PUT /identity/v3/projects/ed2cf543655642049ac3b851c69e0927/users/a4a5d5a3260b4fb3ba99a36571b2ed7b/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:34:43.090705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66aad5-91b8-4edd-88db-250dcff9c855 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:43.130959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:43.131814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.132094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.132369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.140636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:43.142173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:43.158078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:43.158994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:43.165513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 540/1077] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:43.166042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:43.279371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b76f7-65f5-4183-a8e9-f87f6c2c0eac None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:43.314351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:43.315323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.315793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.316453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.317708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:43.318213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:43.319831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb917515-2418-4cf8-b86d-8576ba30afee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:43.333236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 538/1078] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:43.339368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:43.342191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ce0-0190-4330-810a-82ffb751fdd4 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.342468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ce0-0190-4330-810a-82ffb751fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.342747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32971ce0-0190-4330-810a-82ffb751fdd4 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.344441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 539/1079] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:43.350391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.350672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.350948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.368530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:43.370130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:43.388561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:43.407029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:43.447603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 540/1080] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 28 17:34:43.461291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a503c5-593d-41b7-ad7f-b6eae63f85f8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:43.469496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:43.500909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:43.501825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.502139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.502518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/86b5f419b163483e8b08e2daba6a466b` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.504761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=ef1eedbaa7574783adde2884c2b9a482, role_id=86b5f419b163483e8b08e2daba6a466b)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:43.506243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:43.521540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 541/1081] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:43 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/ef1eedbaa7574783adde2884c2b9a482/roles/86b5f419b163483e8b08e2daba6a466b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:34:43.591094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f66a5-f9e0-4ace-b6b6-bb50a9fc8d00 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:43.630544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:43.631220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:43.631504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:43.631776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:43.653286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:43.730228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:43.731611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:43.851748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 541/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 17:34:43.857424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:43.960219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87853b9-6688-477f-ae9a-d4d2ad158780 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:43.978872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:43.999300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:44.000025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:44.000327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:44.000601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:44.011348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:44.012811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-343189e3-6cd2-4239-b742-57a98ecb1975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:44.031000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:44.031994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:44.033132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:44.033132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:44.033132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:44.033132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:44.033132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 542/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:44.039488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:44.117401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:44.207651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01afff0-d2e8-4330-bedd-c4bd13ed67ef None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:44.260161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:44.260644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:44.260917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:44.261219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:44.261932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:44.262251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:44.263647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207601-9347-4b9f-bca4-c17a8b31e4ee None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:44.276821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 542/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:45.061329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba75-31d0-4363-b304-3621e455d4fc None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.061930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba75-31d0-4363-b304-3621e455d4fc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.061930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612ba75-31d0-4363-b304-3621e455d4fc None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.063234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 543/1085] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:45.070477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.071084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.071434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.089889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:45.091136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:45.162658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 543/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:45.186530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ba75-31d0-4363-b304-3621e455d4fc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.297493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612ba75-31d0-4363-b304-3621e455d4fc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.335040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:45.335867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.336150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.336412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.347148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:45.354851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:45.355938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:45.356911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 544/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:45.362320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.403240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.465833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2387321-c25f-4ff5-8425-c5830fcf9033 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.502906 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:45.503586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.503886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.504224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.505081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:45.505382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:45.506818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f73faf-59ff-427a-a070-134aeba86b73 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:45.515476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 544/1088] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:45.521486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.556301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.596884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70751ff-722f-46ed-b09b-c8ff36f58e1d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.597062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70751ff-722f-46ed-b09b-c8ff36f58e1d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.597508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70751ff-722f-46ed-b09b-c8ff36f58e1d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.598956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 545/1089] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:45.604097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.604382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.604654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.622514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:45.623689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:45.629695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cb91d-0e84-41db-94ce-53e150165d93 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.665500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:45.666433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.666722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.667004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] PATH_INFO: `/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.668320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] RBAC: Authorizing `identity:get_user(user_id=a4a5d5a3260b4fb3ba99a36571b2ed7b)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:45.669790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:45.671527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 545/1090] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/users/a4a5d5a3260b4fb3ba99a36571b2ed7b => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:45.677774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.697863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 546/1091] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:45.721732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.752617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.781571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.786045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a34257-9463-4d78-9f5b-2b63ab74f64c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.821773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:45.822472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.822760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.823041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.826458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eef7e-a68d-41e6-840f-2952d41bd6b4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.861847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:45.862637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:45.863099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:45.863386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:45.874106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:34:45.882431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:45.883391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:45.884485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 547/1092] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:45.889748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:45.891921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:45.893397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:45.981280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.990989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57ba5-c9e4-4d3a-a6f4-1d9c61c43e9d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:45.993411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:45.999079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 546/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:46.004542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.027223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.027907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.028188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.028460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.029202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:46.029509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.030921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.044616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 548/1094] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:34:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:46.046288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.108786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f02aff-a69f-4010-a8ba-3ac8ce28713e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.143650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.144728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.145033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.145312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.146527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.147986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.149689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 547/1095] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:46.150917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a858e-746e-4e3c-8546-5355b329cbac None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.155858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.186052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.186891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.187190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.187463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.198373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.199830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:46.217100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:46.218227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:46.219285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:46.219285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:46.219285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:46.219285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:46.219285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 549/1096] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:34:46.222519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:46.225244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.235490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:46.258842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7d5b8-3519-4c37-adbc-a17399f5c822 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.295130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.295789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.296074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.296353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.297177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=ed2cf543655642049ac3b851c69e0927, user.id=a4a5d5a3260b4fb3ba99a36571b2ed7b) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:46.297523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.299356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.305600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 548/1097] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/role_assignments?user.id=a4a5d5a3260b4fb3ba99a36571b2ed7b&scope.project.id=ed2cf543655642049ac3b851c69e0927&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:34:46.330395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb9363-61a9-46d9-9b0e-2036b2480c9f None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.367077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.367763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.368026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.368310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.369046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:46.369415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.370842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.384395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 550/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:46.390584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.501258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ce5a2-5196-4d63-a27a-0ed1fd7a769b None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.531218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:46.538037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.538845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.539125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.539398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.546896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.548676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:34:46.563727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:46.564761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:34:46.565671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 549/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:46.571028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.638942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:46.677990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc9c25-fd4d-4846-82de-f1f535c20d35 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.715161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.715836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.716110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.716380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.717205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:46.717508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.718961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:46.746022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 551/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:46.747770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:46.857300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decbbed-f547-447f-9580-a80679894ef9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:46.896433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:46.897098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:46.897380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:46.897654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:46.959822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:46.971898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:46.973432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:47.086925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 550/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 17:34:47.094704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:47.208956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f7f27-dc5c-481e-9d8e-f79db965ef85 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:47.233414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:47.246205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:47.247018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:47.247303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:47.247576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:47.258651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:47.260093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:34:47.280056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:47.281210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:47.287136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:34:47.287136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:34:47.287136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:34:47.287136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:47.287136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 552/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:47.287464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:47.425700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:47.437021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388f920-3c2e-4587-ab1e-ede001d408ab None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:47.476707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:47.477410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:47.477694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:47.477977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:47.478743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:47.479055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:47.480475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:47.493389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 551/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:47.499296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:47.606357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173b854-bad1-4e9a-a587-6123df489e20 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:47.642417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:47.643218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:47.643609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:47.643740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:47.651287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:47.652708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:34:47.667072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:34:47.668038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:34:47.668917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 553/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:34:47.675064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:47.792622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f27-5a67-4201-81ff-5a502bc01e78 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:47.829009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:47.829670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:47.829975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:47.830244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:47.831031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:47.831337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:47.833503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87028c-57c4-49cf-8513-8b9b126692f2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:47.846431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 552/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:34:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:47.853003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:47.891954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:47.965019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91195809-c2e5-4b3b-b11a-0fef944ff7ff None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:48.004119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:48.004788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:48.005059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:48.005351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:48.006214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] RBAC: Adding query filter params (role.id=86b5f419b163483e8b08e2daba6a466b, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=ef1eedbaa7574783adde2884c2b9a482) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:48.006527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:48.008008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13fb72-e8d7-481d-a013-9eb606441aef None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:48.015124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 554/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:47 2022] GET /identity/v3/role_assignments?user.id=ef1eedbaa7574783adde2884c2b9a482&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=86b5f419b163483e8b08e2daba6a466b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:48.467292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa4a8-bb06-4c2f-bf31-bd6c582403dc None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:48.468042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa4a8-bb06-4c2f-bf31-bd6c582403dc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:48.468042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfa4a8-bb06-4c2f-bf31-bd6c582403dc None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:48.469224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 553/1107] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:48.475813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:48.476368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:48.476368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:48.496204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:48.497574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:48.577675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 555/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:48.602830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa4a8-bb06-4c2f-bf31-bd6c582403dc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:48.617069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:48.743472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfa4a8-bb06-4c2f-bf31-bd6c582403dc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:48.788115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:48.788910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:48.789188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:48.789457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:48.790753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:48.792203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e926d-757c-419b-b291-d3acbb311528 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:48.793853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 554/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:48.800154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:48.843467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:48.931083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3bcf41-0032-4cda-9bdf-7209290bbbc4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:48.971527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:48.972303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:48.972589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:48.972859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:48.973580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:48.975401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbca73-fad6-4333-99f8-951dfafcd91b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:48.998290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 556/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:34:48 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:34:51.075507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f65b-ebfa-45c2-90d5-7f8ad25c4f9a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.076040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f65b-ebfa-45c2-90d5-7f8ad25c4f9a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.076040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6f65b-ebfa-45c2-90d5-7f8ad25c4f9a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.077346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 555/1111] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:51.083000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.083441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.083546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.101882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:51.103132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:51.175040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 557/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:51.199291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f65b-ebfa-45c2-90d5-7f8ad25c4f9a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:51.287832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:51.311966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6f65b-ebfa-45c2-90d5-7f8ad25c4f9a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:51.347997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:51.348783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.349066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.349339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] PATH_INFO: `/v3/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.350888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] RBAC: Authorizing `identity:get_role(role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:51.352266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:51.353663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 556/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:51 2022] GET /identity/v3/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:51.359874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:51.379173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:51.465858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20079489-665e-40ea-afc6-8c1e65a9084a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:51.499522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:51.500413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.500694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.500962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] PATH_INFO: `/v3/users/6b5405267c9248c0ba848b30fa72d7b2` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.514562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5405267c9248c0ba848b30fa72d7b2)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:51.516011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:51.517689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 558/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:51 2022] GET /identity/v3/users/6b5405267c9248c0ba848b30fa72d7b2 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:51.523869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:51.629915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21233b1-5e0b-46dd-aba1-73e9e5ead958 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:51.665151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:51.665794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.666102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.666376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.682679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:51.738591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:51.740049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:51.844230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 557/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:51.850562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:51.932297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:51.959518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e939a-3fef-4835-ba10-6bee7af71572 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:51.994699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:51.995571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:51.995853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:51.996134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:51.997361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:51.998901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70aac1-05db-4afb-82a8-2002a13daecc None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:52.000689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 559/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:51 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:52.009623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:52.057666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:52.112966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81466d2d-397b-44c9-b442-20b05d787940 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:52.147144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:52.147796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:52.148076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:52.148351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:52.149177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=ed2cf543655642049ac3b851c69e0927, user.id=6b5405267c9248c0ba848b30fa72d7b2) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:52.149494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:52.151097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c788d5-d160-4009-9a5c-fde9de51f778 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:52.156758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 558/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:52 2022] GET /identity/v3/role_assignments?user.id=6b5405267c9248c0ba848b30fa72d7b2&scope.project.id=ed2cf543655642049ac3b851c69e0927&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:54.154786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18b6d1-37cf-4581-bb1a-aac2cee9f6aa None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.155326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18b6d1-37cf-4581-bb1a-aac2cee9f6aa None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.155326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18b6d1-37cf-4581-bb1a-aac2cee9f6aa None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.156592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 560/1118] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:34:54.162392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.162833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.162923 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.180480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:54.181661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:54.256927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 559/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:54.285677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18b6d1-37cf-4581-bb1a-aac2cee9f6aa None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:54.390749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18b6d1-37cf-4581-bb1a-aac2cee9f6aa None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:54.428975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:54.429823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.430139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.430432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] PATH_INFO: `/v3/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.431902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] RBAC: Authorizing `identity:get_role(role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:54.433264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:54.434707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 561/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:54 2022] GET /identity/v3/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:54.440842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:54.485015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:54.546946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c7df3-c066-4e2d-99c3-e39de965558a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:54.584316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:54.585200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.585480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.585754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] PATH_INFO: `/v3/users/6b5405267c9248c0ba848b30fa72d7b2` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.586996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5405267c9248c0ba848b30fa72d7b2)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:54.588456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:54.590174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 560/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:54 2022] GET /identity/v3/users/6b5405267c9248c0ba848b30fa72d7b2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:54.596323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:54.609492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:54.698768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f64b3-f2f6-4586-bace-df171676f46a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:54.733244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:54.734147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.734424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.734698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.735884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:54.737312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cd22f-af61-4252-b757-2e9396eb2bb8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:54.739091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 562/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:54 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:54.745416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:54.849006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08caa3-3bdf-4a61-842a-58c467951a78 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:54.858581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:54.886431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:54.887344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:54.887632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:54.887909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927/users/6b5405267c9248c0ba848b30fa72d7b2/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:54.890240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed2cf543655642049ac3b851c69e0927, user_id=6b5405267c9248c0ba848b30fa72d7b2, role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:54.891688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc860e7-61c4-4fd2-bf91-b05f0617511a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:54.905677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 561/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:34:54 2022] PUT /identity/v3/projects/ed2cf543655642049ac3b851c69e0927/users/6b5405267c9248c0ba848b30fa72d7b2/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:34:56.919690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f069-9b7e-4975-951c-22770ad015e6 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:56.920248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f069-9b7e-4975-951c-22770ad015e6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:56.920248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03f069-9b7e-4975-951c-22770ad015e6 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:56.921602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 563/1124] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:34:56.927408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:56.927832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:56.927921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:56.946324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:34:56.947529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:34:57.023153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 562/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:34:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:34:57.047853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f069-9b7e-4975-951c-22770ad015e6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:57.133016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:57.156463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03f069-9b7e-4975-951c-22770ad015e6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:57.192284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:57.193156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:57.193436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:57.193706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] PATH_INFO: `/v3/roles/b9ff7ff244f14ed5837fd860bb57f627` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:57.195261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] RBAC: Authorizing `identity:get_role(role_id=b9ff7ff244f14ed5837fd860bb57f627)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:57.196636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:57.198040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 564/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:57 2022] GET /identity/v3/roles/b9ff7ff244f14ed5837fd860bb57f627 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:57.204185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:57.304742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:57.308402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f39e88-e8c1-4e93-9914-eab39aa32a3a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:57.344816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:57.345691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:57.345981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:57.346264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] PATH_INFO: `/v3/users/6b5405267c9248c0ba848b30fa72d7b2` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:57.347581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] RBAC: Authorizing `identity:get_user(user_id=6b5405267c9248c0ba848b30fa72d7b2)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:57.349022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:57.350700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 563/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:34:57 2022] GET /identity/v3/users/6b5405267c9248c0ba848b30fa72d7b2 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:57.356909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:57.462211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d57c3-8ac6-4651-98fe-4c23c280cf09 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:57.497884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:57.498563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:57.498848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:57.499130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:57.514760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:57.569315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:57.570728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:57.676013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 565/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:34:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:34:57.682310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:57.791257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9fc1c-e4bb-4313-bcf3-4723f17ead11 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:57.827053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:57.827863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:57.828147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:57.828418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] PATH_INFO: `/v3/projects/ed2cf543655642049ac3b851c69e0927` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:57.829660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2cf543655642049ac3b851c69e0927)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:57.831168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00f408-0c55-4b3a-bea4-27f45c8bd8d1 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:57.832932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 564/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:34:57 2022] GET /identity/v3/projects/ed2cf543655642049ac3b851c69e0927 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:34:57.839352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:34:57.884969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:34:57.943170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e3f2b-c29f-4799-beb6-88bb32fd201c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:34:57.978208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:34:57.978868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:34:57.979152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:34:57.979432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:34:57.980249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] RBAC: Adding query filter params (role.id=b9ff7ff244f14ed5837fd860bb57f627, scope.project.id=ed2cf543655642049ac3b851c69e0927, user.id=6b5405267c9248c0ba848b30fa72d7b2) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:34:57.980565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:34:57.981980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c821c-43e0-46c1-91b3-c08416ff524a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:34:57.988323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 566/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:34:57 2022] GET /identity/v3/role_assignments?user.id=6b5405267c9248c0ba848b30fa72d7b2&scope.project.id=ed2cf543655642049ac3b851c69e0927&role.id=b9ff7ff244f14ed5837fd860bb57f627 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:00.047928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1247c51-f488-4d4a-ac32-5a8ad2cab3c3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:00.048842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1247c51-f488-4d4a-ac32-5a8ad2cab3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:00.048842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1247c51-f488-4d4a-ac32-5a8ad2cab3c3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:00.050123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 565/1131] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:00.055974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77865-6315-4d60-9b93-c588436657ea None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:00.056441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77865-6315-4d60-9b93-c588436657ea None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:00.056545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac77865-6315-4d60-9b93-c588436657ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:00.074762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-aac77865-6315-4d60-9b93-c588436657ea None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:00.075975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-aac77865-6315-4d60-9b93-c588436657ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:00.148722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 567/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:00.172505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1247c51-f488-4d4a-ac32-5a8ad2cab3c3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:00.210298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:00.280161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1247c51-f488-4d4a-ac32-5a8ad2cab3c3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:00.315408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:00.316177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:00.316496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:00.316823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:00.318103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:00.319598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e646c3-4bf8-4dc2-8875-3dcff57d189c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:00.321284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 566/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:00.327293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac77865-6315-4d60-9b93-c588436657ea None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:00.369915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:00.431587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac77865-6315-4d60-9b93-c588436657ea None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:00.466244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:00.466915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:00.467189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:00.467467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:00.468150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:00.469620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbbe24-3e89-4528-b3f4-b5cf6037c866 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:00.495626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 568/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:35:00 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:35:02.583266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631abab-55b9-4354-a78d-cd3d3b483141 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:02.583857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631abab-55b9-4354-a78d-cd3d3b483141 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:02.583857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631abab-55b9-4354-a78d-cd3d3b483141 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:02.585198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 567/1135] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:02.590895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2207-87b0-4551-8148-222827efe9fb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:02.591345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2207-87b0-4551-8148-222827efe9fb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:02.591434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2207-87b0-4551-8148-222827efe9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:02.609248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-075c2207-87b0-4551-8148-222827efe9fb None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:02.610472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-075c2207-87b0-4551-8148-222827efe9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:02.690292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 569/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:02.716421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631abab-55b9-4354-a78d-cd3d3b483141 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:02.845666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631abab-55b9-4354-a78d-cd3d3b483141 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:02.848187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:02.897657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:02.898523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:02.898805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:02.899083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:02.900409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:02.901873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3668cab-8f96-49be-a555-2f3cc9e00853 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:02.903630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 568/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:02.910241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2207-87b0-4551-8148-222827efe9fb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:02.938766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:03.027502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2207-87b0-4551-8148-222827efe9fb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:03.063142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:03.063813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:03.064090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:03.064359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:03.065063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:03.066824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1a7dc-0a22-4200-90dc-911abf0f55ef None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:03.088981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 570/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:35:02 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:35:05.183571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980c00-8d6c-430b-9a35-8619ad572dff None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.184155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980c00-8d6c-430b-9a35-8619ad572dff None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.184155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c980c00-8d6c-430b-9a35-8619ad572dff None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:05.185517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 569/1139] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:05.191392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.191860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.191969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:05.210059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:05.211281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:05.282521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 571/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:05.307247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980c00-8d6c-430b-9a35-8619ad572dff None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:05.416596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c980c00-8d6c-430b-9a35-8619ad572dff None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:05.455098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:05.455818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.456099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.456376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:05.467710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:05.475572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:05.476694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:05.477782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 570/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:05.483080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:05.494421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:05.594957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff9a66-fe56-4b2d-bfa6-94d5ec4167f5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:05.631541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:05.632202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.632480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.632749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:05.633490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:05.633794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:05.635189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:05.645178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 572/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:05.651497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:05.687582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:05.765907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da87e0-ceb3-40d7-b8b3-00546b64f4e1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:05.807547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:05.808438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.808716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.808985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] PATH_INFO: `/v3/users/b3b7f18168f044879bc0040b4fc6556f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:05.825840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b7f18168f044879bc0040b4fc6556f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:05.827378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:05.829208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 571/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:05 2022] GET /identity/v3/users/b3b7f18168f044879bc0040b4fc6556f => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:05.835989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:05.913140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:05.945894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269602-2279-462a-aa14-e07dbdb1ed3e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:05.979570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:05.980219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:05.980495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:05.980763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:06.049816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:06.051242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:06.120964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:06.154041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 573/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:35:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:35:06.161421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:06.305607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:06.326484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e824-ae76-4066-9582-2628adddff67 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:06.383167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:06.384404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:06.384808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:06.385192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] PATH_INFO: `/v3/projects/138efa86c83d4019b5130bd526f766f3` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:06.386896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] RBAC: Authorizing `identity:get_project(project_id=138efa86c83d4019b5130bd526f766f3)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:06.389227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cb0c4-25d0-46e2-b27c-47b17e96ddc2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:06.391725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 572/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:06 2022] GET /identity/v3/projects/138efa86c83d4019b5130bd526f766f3 => generated 311 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:06.401307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:06.523043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884ebd6-7e7b-4e58-8e49-67fc34817347 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:06.561057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:06.561623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:06.561899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:06.562176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:06.562993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=138efa86c83d4019b5130bd526f766f3, user.id=b3b7f18168f044879bc0040b4fc6556f) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:06.563304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:06.564736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bcbd7-cd9f-44d7-9fe8-45c14b21fb43 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:06.571067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 574/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:35:06 2022] GET /identity/v3/role_assignments?user.id=b3b7f18168f044879bc0040b4fc6556f&scope.project.id=138efa86c83d4019b5130bd526f766f3&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:08.599100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac2a8-5b88-4c73-9aff-b6096fcacd51 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:08.599705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac2a8-5b88-4c73-9aff-b6096fcacd51 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:08.599705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cac2a8-5b88-4c73-9aff-b6096fcacd51 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:08.601022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 573/1147] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:08.606634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:08.607046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:08.607198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:08.624957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:08.626197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:08.654849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:08.697974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 575/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:08.721388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac2a8-5b88-4c73-9aff-b6096fcacd51 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:08.828880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cac2a8-5b88-4c73-9aff-b6096fcacd51 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:08.864738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:08.865447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:08.865728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:08.866036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:08.876808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:08.884474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:08.885565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:08.886537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 574/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:08.892442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:08.994221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e42ef-677c-470c-94c7-bd778ae1fd64 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:09.028625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:09.029285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:09.029562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:09.029832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:09.030598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:09.030903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:09.032270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:09.040510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 576/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:09.047065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:09.067993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:09.152989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd60a2-44a5-46a1-9328-058e718ce7bb None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:09.188459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:09.189414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:09.189599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:09.189903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] PATH_INFO: `/v3/users/b3b7f18168f044879bc0040b4fc6556f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:09.191320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b7f18168f044879bc0040b4fc6556f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:09.192777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:09.194458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 575/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:09 2022] GET /identity/v3/users/b3b7f18168f044879bc0040b4fc6556f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:09.200592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:09.229724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:09.310728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0e22-6652-438b-88f9-6371b6dbb9c4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:09.345419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:09.346322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:09.346597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:09.346879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] PATH_INFO: `/v3/projects/138efa86c83d4019b5130bd526f766f3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:09.348215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] RBAC: Authorizing `identity:get_project(project_id=138efa86c83d4019b5130bd526f766f3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:09.349656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbf1a4-25d3-4a4d-8bdc-c2bb81720377 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:09.351389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 577/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:09 2022] GET /identity/v3/projects/138efa86c83d4019b5130bd526f766f3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:09.357602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:09.444968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:09.460941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53a566-8aef-44fb-a0d6-dd9cfa8430a5 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:09.494009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:09.494904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:09.495184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:09.495457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] PATH_INFO: `/v3/projects/138efa86c83d4019b5130bd526f766f3/users/b3b7f18168f044879bc0040b4fc6556f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:09.497439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=138efa86c83d4019b5130bd526f766f3, user_id=b3b7f18168f044879bc0040b4fc6556f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:09.498909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c46a1c-3fbc-42c4-aebe-8bb72627c5c9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:09.513411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 576/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:35:09 2022] PUT /identity/v3/projects/138efa86c83d4019b5130bd526f766f3/users/b3b7f18168f044879bc0040b4fc6556f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:35:11.539950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db91e3-96bd-422e-a3f9-b7a988edfc3d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:11.540515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db91e3-96bd-422e-a3f9-b7a988edfc3d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:11.540515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db91e3-96bd-422e-a3f9-b7a988edfc3d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:11.541843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 578/1154] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:11.547171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:11.547623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:11.547724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:11.565545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:11.566839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:11.634277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 577/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:11.660413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db91e3-96bd-422e-a3f9-b7a988edfc3d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:11.767329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:11.776112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db91e3-96bd-422e-a3f9-b7a988edfc3d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:11.817086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:11.817795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:11.818101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:11.818370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:11.829135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:11.837314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:11.838496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:35:11.839456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 579/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:11.844956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:11.923287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:11.950892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5be7e1-ff62-4c76-93a8-4482f12b283b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:11.993650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:11.994360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:11.994640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:11.994915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:11.995890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:11.996213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:11.997810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:12.007617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 578/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:12.013656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:12.119288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a32e-45cc-44c6-be77-84252de6a1e3 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:12.154429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:12.155306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:12.155578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:12.155846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] PATH_INFO: `/v3/users/b3b7f18168f044879bc0040b4fc6556f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:12.157068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] RBAC: Authorizing `identity:get_user(user_id=b3b7f18168f044879bc0040b4fc6556f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:12.158538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:12.160395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 580/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:12 2022] GET /identity/v3/users/b3b7f18168f044879bc0040b4fc6556f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:12.166478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:12.270048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c90268-35a5-4fff-8c27-3549613ef157 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:12.305206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:12.305851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:12.306166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:12.306437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:12.310071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:12.375698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:12.377065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:12.480961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 579/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:35:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:35:12.487213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:12.512829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:12.590540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75dece-2cb3-43e1-9b45-0322ef73e459 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:12.624868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:12.625801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:12.626012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:12.626313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] PATH_INFO: `/v3/projects/138efa86c83d4019b5130bd526f766f3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:12.627526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] RBAC: Authorizing `identity:get_project(project_id=138efa86c83d4019b5130bd526f766f3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:12.628993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea8557-7654-4247-88e1-2bec59d364be None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:12.630808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 581/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:12 2022] GET /identity/v3/projects/138efa86c83d4019b5130bd526f766f3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:35:12.637141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:12.675623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:12.742575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca929-7e20-4f12-930a-26c3d90c3f9e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:12.779707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:12.780375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:12.780667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:12.780939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:12.781774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=138efa86c83d4019b5130bd526f766f3, user.id=b3b7f18168f044879bc0040b4fc6556f) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:12.782123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:12.783586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fba24-0f46-491c-80d5-318385653c05 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:12.790083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 580/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:35:12 2022] GET /identity/v3/role_assignments?user.id=b3b7f18168f044879bc0040b4fc6556f&scope.project.id=138efa86c83d4019b5130bd526f766f3&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:14.842143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396829-5211-4c5b-ade3-d3fbe6e75c1f None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:14.842743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396829-5211-4c5b-ade3-d3fbe6e75c1f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:14.842743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396829-5211-4c5b-ade3-d3fbe6e75c1f None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:14.844049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 582/1162] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:14.849796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:14.850262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:14.850373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:14.868632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:14.869841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:14.943172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 581/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:14.966277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35396829-5211-4c5b-ade3-d3fbe6e75c1f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:15.065298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:15.077581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35396829-5211-4c5b-ade3-d3fbe6e75c1f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:15.115463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:15.116120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:15.116400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:15.116674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:15.186984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:15.188448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:15.279575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:15.291722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 583/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:35:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:35:15.298086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:15.330393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:15.406241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fa3f8-a3be-4eba-9612-4a1f09f4511b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:15.442894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:15.443707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:15.443990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:15.444262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:15.451258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:15.452722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-bae16f1a-b1a1-4624-8b78-75ba683c2d43 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:15.467699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:15.469068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:15.470154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 582/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:35:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:15.475439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:15.582278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd496ff3-d9ff-4797-bd66-4906d4993411 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:15.619964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:15.620655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:15.620935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:15.621204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:15.621923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:15.622259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:15.623616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab12558-bc07-4940-883f-2588b53367a8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:15.631342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 584/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Tue Jun 28 17:35:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:17.696240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bff23-e4e4-4cb1-9ad6-beb76584145e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:17.696836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bff23-e4e4-4cb1-9ad6-beb76584145e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:17.696836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bff23-e4e4-4cb1-9ad6-beb76584145e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:17.698193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 583/1167] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:17.704036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1dd1-bae0-4e80-953a-bccc077a0ecd None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:17.704631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1dd1-bae0-4e80-953a-bccc077a0ecd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:17.704631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1dd1-bae0-4e80-953a-bccc077a0ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:17.723506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-61be1dd1-bae0-4e80-953a-bccc077a0ecd None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:17.724717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-61be1dd1-bae0-4e80-953a-bccc077a0ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:17.779730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:17.800055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 585/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:17.823761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bff23-e4e4-4cb1-9ad6-beb76584145e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:17.921252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:17.934169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bff23-e4e4-4cb1-9ad6-beb76584145e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:17.969446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:17.970056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:17.970337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:17.970610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:17.971339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:17.973277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0337679-9184-4c61-a9d4-e45af92fff6a None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:17.989065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 584/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Tue Jun 28 17:35:17 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:35:20.027572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8973-d6d9-40b9-b853-3e51a8af300e None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:20.028102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8973-d6d9-40b9-b853-3e51a8af300e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:20.028102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8973-d6d9-40b9-b853-3e51a8af300e None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:20.029414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 586/1170] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:20.034751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:20.035194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:20.035291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:20.058374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:20.059602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:20.131271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 585/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:20.155131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d8973-d6d9-40b9-b853-3e51a8af300e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:20.261407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d8973-d6d9-40b9-b853-3e51a8af300e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:20.297031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:20.297817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:20.298130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:20.298403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] PATH_INFO: `/v3/domains/a68fff27a32f44758cdfbea597df05a9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:20.309889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a68fff27a32f44758cdfbea597df05a9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:20.311377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf7b02-4c0e-4d4e-b22d-536a0f791571 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:20.313040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 587/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Jun 28 17:35:20 2022] GET /identity/v3/domains/a68fff27a32f44758cdfbea597df05a9 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:20.319415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:20.403318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:20.425009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d12ff-189d-4e32-a091-2b93d596c152 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:20.459908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:20.460571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:20.460859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:20.461126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:20.461819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:20.463298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc398-ac4e-4358-88ac-dbf314af162e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:20.489998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 586/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:35:20 2022] POST /identity/v3/projects => generated 361 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:35:22.517652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227471b-2bbc-42c9-95b9-e72a4ab4c74d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:22.518568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227471b-2bbc-42c9-95b9-e72a4ab4c74d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:22.518568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227471b-2bbc-42c9-95b9-e72a4ab4c74d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:22.520410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 588/1174] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:22.526599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:22.527075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:22.527226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:22.546733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:22.547947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:22.618780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 587/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:22.645110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227471b-2bbc-42c9-95b9-e72a4ab4c74d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:22.698978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:22.760148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227471b-2bbc-42c9-95b9-e72a4ab4c74d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:22.796675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:22.797551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:22.797825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:22.798138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] PATH_INFO: `/v3/domains/a68fff27a32f44758cdfbea597df05a9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:22.799675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a68fff27a32f44758cdfbea597df05a9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:22.801706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86ecc-93fb-4fa4-a050-82b502bfde34 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:22.803374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 589/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Tue Jun 28 17:35:22 2022] GET /identity/v3/domains/a68fff27a32f44758cdfbea597df05a9 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:22.809616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:22.881404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:22.924946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e5f70-9ac5-4660-ba5f-d085abe5b6f9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:22.963044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:22.963714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:22.964008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:22.964280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:22.965004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:22.966530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419493b9-c56d-46a5-9083-027d2458edea None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:22.993890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 588/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:35:22 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:35:25.120230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdd115-d39c-4af3-a17f-617f5fc98e3a None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.120756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdd115-d39c-4af3-a17f-617f5fc98e3a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.120756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdd115-d39c-4af3-a17f-617f5fc98e3a None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:25.122027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 590/1178] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:25.127857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.128363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.128524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:25.146533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:25.147868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:25.226631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 589/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:25.250398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdd115-d39c-4af3-a17f-617f5fc98e3a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:25.361444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdd115-d39c-4af3-a17f-617f5fc98e3a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:25.375843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:25.398889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:25.399689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.399965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.400237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:25.410976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:25.418558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:25.419604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:35:25.420598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 591/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:25.426953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:25.477799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:25.529380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ec480-e599-44cb-b9cd-bc25558dd585 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:25.565198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:25.565865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.566325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.566724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:25.567522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:25.567824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:25.569205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:25.577542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 590/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:35:25.583696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:25.700012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9b68-f03d-4aa6-b303-29c120890892 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:25.737387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:25.738994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.739283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.739561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] PATH_INFO: `/v3/users/3579fc47c64141a69b418302ed7af870` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:25.756983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] RBAC: Authorizing `identity:get_user(user_id=3579fc47c64141a69b418302ed7af870)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:25.758520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:25.760506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 592/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:25 2022] GET /identity/v3/users/3579fc47c64141a69b418302ed7af870 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:25.767622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:25.894220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09779bc6-cba5-4308-82eb-9153e58a810f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:25.905684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:25.933658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:25.934342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:25.934753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:25.935112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:26.032436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:26.033812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:26.159094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 591/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:35:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:35:26.166203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:26.202271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:26.293491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfece510-e297-4c00-b155-2e399b54c9ae None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:26.330196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:26.331074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:26.331354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:26.331701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] PATH_INFO: `/v3/projects/13e80773919041a4a927bd745b793e0e` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:26.333538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=13e80773919041a4a927bd745b793e0e)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:26.335009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ecd0a-d40b-4273-b8cd-b61c77dbc4d6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:26.336804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 593/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:26 2022] GET /identity/v3/projects/13e80773919041a4a927bd745b793e0e => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:26.343097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:26.357008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:26.474155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9d0c9-6b20-4e90-808c-0420fdfa6a44 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:26.517830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:26.523154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:26.523415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:26.523718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:26.524545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=13e80773919041a4a927bd745b793e0e, user.id=3579fc47c64141a69b418302ed7af870) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:26.524858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:26.526334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b2d8-b092-4570-80de-975a4443177d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:26.532216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 592/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:35:26 2022] GET /identity/v3/role_assignments?user.id=3579fc47c64141a69b418302ed7af870&scope.project.id=13e80773919041a4a927bd745b793e0e&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:35:28.615480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204dfd-58ac-445d-b6c7-b0ac4c9bb909 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:28.616152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204dfd-58ac-445d-b6c7-b0ac4c9bb909 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:28.616152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204dfd-58ac-445d-b6c7-b0ac4c9bb909 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:28.617458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 594/1186] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:28.624057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:28.624663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:28.624663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:28.644000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:28.645461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:28.726709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 593/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:28.750607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03204dfd-58ac-445d-b6c7-b0ac4c9bb909 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:28.864788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:28.871179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03204dfd-58ac-445d-b6c7-b0ac4c9bb909 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:28.912808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:28.913619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:28.913895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:28.914200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:28.925869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:28.933616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:28.934864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:35:28.935698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 595/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:28.941720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:28.945054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:29.046324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2f1d5-b35c-4821-b4aa-cb2ecbfc0cab None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:29.083437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:29.084127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:29.084403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:29.084674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:29.085406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:29.085709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:29.087235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:29.095791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 594/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:29.101933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:29.206368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940caef6-6e05-4606-9d3f-c8fda9f42a0d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:29.243356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:29.244482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:29.244958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:29.245432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] PATH_INFO: `/v3/users/3579fc47c64141a69b418302ed7af870` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:29.247170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] RBAC: Authorizing `identity:get_user(user_id=3579fc47c64141a69b418302ed7af870)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:29.248606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:29.250278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 596/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:29 2022] GET /identity/v3/users/3579fc47c64141a69b418302ed7af870 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:29.257354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:29.327818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:29.364130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbd603-baec-45ab-9936-ddbf4d12ea79 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:29.399327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:29.400196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:29.400475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:29.400758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] PATH_INFO: `/v3/projects/13e80773919041a4a927bd745b793e0e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:29.402044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] RBAC: Authorizing `identity:get_project(project_id=13e80773919041a4a927bd745b793e0e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:29.403516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c1e8-8c3f-4b89-b586-371db0e8a708 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:29.405261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 595/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:29 2022] GET /identity/v3/projects/13e80773919041a4a927bd745b793e0e => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:29.411641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:29.447475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:29.529515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e5d1-203e-41a2-9040-f5d6eb67b3f1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:29.567986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:29.568890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:29.569201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:29.569426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] PATH_INFO: `/v3/projects/13e80773919041a4a927bd745b793e0e/users/3579fc47c64141a69b418302ed7af870/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:29.571492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] RBAC: Authorizing `identity:create_grant(project_id=13e80773919041a4a927bd745b793e0e, user_id=3579fc47c64141a69b418302ed7af870, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:29.572923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89114f8e-40ce-4f58-be21-e55831581798 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:29.587487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 597/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:35:29 2022] PUT /identity/v3/projects/13e80773919041a4a927bd745b793e0e/users/3579fc47c64141a69b418302ed7af870/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:35:31.624325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7998b8-befe-4691-95d1-26fe8294bacf None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:31.624907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7998b8-befe-4691-95d1-26fe8294bacf None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:31.624907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7998b8-befe-4691-95d1-26fe8294bacf None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:31.626346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 596/1193] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:35:31.632507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:31.633016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:31.633188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:31.656321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:35:31.658107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:35:31.757756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 598/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:35:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:35:31.782294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7998b8-befe-4691-95d1-26fe8294bacf None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:31.894045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7998b8-befe-4691-95d1-26fe8294bacf None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:31.931123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:31.931935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:31.932222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:31.932500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:31.935394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:31.949853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:35:31.958073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:35:31.959171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:35:31.960052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 597/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:35:31.966063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:31.991773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:32.085461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056d2c6-fbf5-4792-be18-908a45808169 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:32.122623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:32.123301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:32.123578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:32.124008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:32.124763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:32.125096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:32.126678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:32.136014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 599/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:32.142447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:32.249799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cf7e1-5644-4c86-8ecb-6d19f736fcc1 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:32.287214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:32.288101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:32.288374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:32.288648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] PATH_INFO: `/v3/users/3579fc47c64141a69b418302ed7af870` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:32.289853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] RBAC: Authorizing `identity:get_user(user_id=3579fc47c64141a69b418302ed7af870)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:32.291439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:32.293287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 598/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Tue Jun 28 17:35:32 2022] GET /identity/v3/users/3579fc47c64141a69b418302ed7af870 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:32.299710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:32.383899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:32.406987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9165-0803-42bc-af70-d65ff2c60ac8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:32.442227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:32.443018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:32.443298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:32.443569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:32.514502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:32.516031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:32.608965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:32.633728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 600/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:35:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:35:32.640104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:32.714373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:32.754217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376ead9-2b92-46b3-aeca-b089cac99a0d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:32.795146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:32.796057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:32.796341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:32.796624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] PATH_INFO: `/v3/projects/13e80773919041a4a927bd745b793e0e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:32.798031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] RBAC: Authorizing `identity:get_project(project_id=13e80773919041a4a927bd745b793e0e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:32.799928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb985d-f9d8-4494-972b-65759d3cbb0c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:32.802287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 599/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Tue Jun 28 17:35:32 2022] GET /identity/v3/projects/13e80773919041a4a927bd745b793e0e => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:32.809275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:35:32.919748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b0779-dd03-4f69-925a-3b1f59442bd6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:35:32.957618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:35:32.958382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:35:32.958660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:35:32.958947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:35:32.959788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=13e80773919041a4a927bd745b793e0e, user.id=3579fc47c64141a69b418302ed7af870) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:35:32.960096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:35:32.963874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8481e86-3221-4b81-a97e-31d3dbec8f1a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:35:32.970865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 601/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:35:32 2022] GET /identity/v3/role_assignments?user.id=3579fc47c64141a69b418302ed7af870&scope.project.id=13e80773919041a4a927bd745b793e0e&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:35:42.790689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=35 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:35:42.967797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=79 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:31.214904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f85f-656a-47aa-baf0-5538a851bb52 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:31.216017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f85f-656a-47aa-baf0-5538a851bb52 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:31.216017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f85f-656a-47aa-baf0-5538a851bb52 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:31.221976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 600/1201] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:36:31.226366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:31.226905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:31.227392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:31.257591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:31.259505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:31.380712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 602/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:31.408764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f85f-656a-47aa-baf0-5538a851bb52 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:31.577319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f85f-656a-47aa-baf0-5538a851bb52 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:31.638265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:31.639853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:31.640464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:31.640930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:31.655951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:31.657896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:31.688844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:31.690424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:31.692280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:31.692280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:31.692280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:31.692280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:31.692280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 601/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:31.697919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:31.849644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d346ec-713e-4e00-994a-9f666c6ab68a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:31.902381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:31.915366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:31.916514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:31.917124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:31.917124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:31.918251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:31.918686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:31.920584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a0e00-78e8-4415-b6e3-276710bf8675 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:31.947533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 603/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:31.954988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:32.067255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:32.170842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c24b4-1c63-4c3e-9946-3e14b04a7b90 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:32.243763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:32.245034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:32.245703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:32.246256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:32.247688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:32.250875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525eca3-7f8a-4393-83a7-787d10947ae2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:32.298537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 602/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Tue Jun 28 17:36:31 2022] POST /identity/v3/users => generated 251 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:36:34.672967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292dd4-3c97-4f08-80d6-38d2cd804b55 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:34.673827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292dd4-3c97-4f08-80d6-38d2cd804b55 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:34.673827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0292dd4-3c97-4f08-80d6-38d2cd804b55 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:34.675394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 604/1206] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:36:34.682614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:34.683395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:34.683395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:34.701897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:34.703209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:34.807055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 603/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:34.836750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292dd4-3c97-4f08-80d6-38d2cd804b55 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:34.981811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0292dd4-3c97-4f08-80d6-38d2cd804b55 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:35.037976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:35.039002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:35.039392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:35.039758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:35.057370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:35.066683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:35.068922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:35.069777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 605/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:36:35.075738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:35.132648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:35.228618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5f93b-d888-469e-96d8-68a699bafa9b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:35.284983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:35.286020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:35.286317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:35.286586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:35.287338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:35.287646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:35.289201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:35.299433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 604/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:36:35.305137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:35.364797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:35.467185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fae27-ce9c-4e14-9c61-3ac2fc8e0eb1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:35.534664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:35.535850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:35.536171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:35.536515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:35.551792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:35.553922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:35.579773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:35.581023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:35.582537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:35.582537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:35.582537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:35.582537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:35.582537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 606/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:35.588023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:35.722452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:35.727006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cab19a-ba17-4bb0-9a41-745834300af9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:35.780400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:35.780754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:35.781093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:35.781484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:35.782588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:35.783032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:35.785219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:35.815019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 605/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:35.822357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:35.995807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d228ec6-a057-4bf1-ad22-21cf474fb89b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:35.998885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:36.058920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:36.060144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:36.060457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:36.060926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:36.078717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:36.081762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:36:36.115501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:36.118180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:36.121096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 607/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:36.125327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:36.323004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4d486-755a-4e02-a90a-1a95e605b4db None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:36.392839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:36.393641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:36.393841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:36.394155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:36.395087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:36.395501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:36.398034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:36.422060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 606/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:36:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:36.429380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:36.587799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006487ad-3b71-4ede-b30b-cbb5c144fb06 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:36.640942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:36.641648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:36.641924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:36.642224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:36.686001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:36.751848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:36.754062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:36.890677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 608/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:36:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:36:36.897345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:36.928863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:37.066231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97532ee-c669-4bbd-b2df-72ae0dec1cb0 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:37.126102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:37.127224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:37.127722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:37.128292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:37.148945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:37.151656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:37.186577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:37.187745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:37.188932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:37.188932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:37.188932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:37.188932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:37.189738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 607/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:37.195925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:37.286771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:37.340218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb77bc8-42cd-41a5-8f65-f96a8ba30192 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:37.384411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:37.385122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:37.385432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:37.385736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:37.386634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:37.386944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:37.388528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:37.413409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 609/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:37.413704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:37.507496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:37.551889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06342bf-e2bd-4fca-9116-c43e32aab58d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:37.607843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:37.608815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:37.609315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:37.609640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:37.618683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:37.620207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:36:37.636814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:37.637834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:37.638868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 608/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:37.645216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:37.845357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a14775-d698-42c8-857c-4749ec2ac98c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:37.884473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:37.910236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:37.911790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:37.912114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:37.912420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:37.914161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:37.914520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:37.916067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e497b9-2b51-42d9-b46b-d986837f6123 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:37.931165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 610/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:37.939149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:38.090835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ce1c-6dd1-4310-9aa3-54719b129dd8 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:38.126735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:38.138169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:38.141472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:38.141472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:38.141472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:38.141472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=266fca3c917546fa8de7b25c77c5fd0a) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:38.141472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:38.142825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3c4ff-1ed8-4b2b-be03-a2b5a43913bb None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:38.153066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 609/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:36:37 2022] GET /identity/v3/role_assignments?user.id=266fca3c917546fa8de7b25c77c5fd0a&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:40.422725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90ce10-d60c-4479-a494-147b39c2acd2 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:40.423391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90ce10-d60c-4479-a494-147b39c2acd2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:40.423391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90ce10-d60c-4479-a494-147b39c2acd2 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:40.425125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 611/1220] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:36:40.432496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:40.433039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:40.433143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:40.455945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:40.457458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:40.547381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 610/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:40.572766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90ce10-d60c-4479-a494-147b39c2acd2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:40.719729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90ce10-d60c-4479-a494-147b39c2acd2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:40.771253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:40.772361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:40.772686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:40.773026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:40.786219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:40.794370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:40.796357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:40.798423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 612/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:40.803128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:40.932351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea625ab2-ea2f-409f-87bf-56013130c1e3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:40.977496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:40.996354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:40.997767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:40.998330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:40.998926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:41.000513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] RBAC: Adding query filter params (name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:41.001081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:41.003789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:41.020544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 611/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:41.028101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:41.093107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:41.166648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb683-27f2-4565-92ed-c6e5f52de9b5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:41.203267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:41.204088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:41.204365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:41.204636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:41.216812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:41.218584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:41.240374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:41.242256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:41.244046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:41.244046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:41.244046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:41.244046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:41.244046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 613/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:41.247853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:41.378496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a1701-f5d0-42c2-88c9-663c3252ca41 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:41.416756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:41.417440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:41.417718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:41.418018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:41.418754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:41.419060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:41.420495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:41.433789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 612/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:41.445180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:41.582132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:41.590371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575858-6d2c-4b7a-adc3-2f5dadad235e None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:41.634429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:41.635822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:41.636297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:41.636773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:41.651451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:41.653894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:36:41.677172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:41.683816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:41.684949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 614/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:36:41.685847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:41.747894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:41.823092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479824f8-4e9d-4473-af6a-f60f4cf7e452 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:41.875705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:41.876295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:41.876571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:41.876841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:41.877697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:41.878083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:41.880117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:41.905030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 613/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:36:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:41.911674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:42.058344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138f8d-1ce1-49da-92ec-96faa4983bb2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:42.103847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:42.104705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:42.105012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:42.105275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:42.120759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:42.123148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:42.148353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:42.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:42.150597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:42.150597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:42.150597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:42.150597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:42.150597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 615/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:36:42.155886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:42.291740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df32cb-5af0-4350-895d-a48fed8cd5af None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:42.294538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:42.339549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:42.340565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:42.340920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:42.341313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:42.342359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:42.342837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:42.345020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:42.366583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 614/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:42.368102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:42.379368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:42.545415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d493871-4fcc-4bb2-9c83-8a9e3849fc4c None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:42.607572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:42.608949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:42.609446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:42.609990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:42.623775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:42.626455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:36:42.646092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:42.647202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:42.653034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 616/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:42.654783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:42.797502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1e468-d108-4d2a-8534-ce38c9cf6844 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:42.843041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:42.843725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:42.844069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:42.844272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:42.845178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:42.845349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:42.846910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b912f-1f4a-4591-bdaa-c86c0c9aa8c4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:42.868459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 615/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:42.869823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:42.962518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:43.008768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a85fc-c0d1-4770-8db8-874a13603be5 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:43.064536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:43.065520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:43.065806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:43.066116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/266fca3c917546fa8de7b25c77c5fd0a/roles/53846e3ec5e846a2b4f53467fb1a87e6` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:43.085351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=266fca3c917546fa8de7b25c77c5fd0a, role_id=53846e3ec5e846a2b4f53467fb1a87e6)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:43.086921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965c56e-6db6-43c9-88f6-c72ce7473498 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:43.102016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 617/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:36:42 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/266fca3c917546fa8de7b25c77c5fd0a/roles/53846e3ec5e846a2b4f53467fb1a87e6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:36:45.206157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123067e-d777-4c3b-9eac-6c65fd255579 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:45.206838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123067e-d777-4c3b-9eac-6c65fd255579 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:45.206838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123067e-d777-4c3b-9eac-6c65fd255579 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:45.208787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 616/1233] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:36:45.216002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:45.216002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:45.216002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:45.233674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:45.234901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:45.307505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 618/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:45.332814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123067e-d777-4c3b-9eac-6c65fd255579 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:45.360798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:45.449820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123067e-d777-4c3b-9eac-6c65fd255579 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:45.491627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:45.492431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:45.492716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:45.492993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:45.504457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:45.512482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:45.513436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:45.514580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 617/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Tue Jun 28 17:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:45.520350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:45.570796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:45.630313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383b47-5a91-4cc7-8e0b-fd14209cd725 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:45.669488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:45.671691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:45.671691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:45.671691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:45.671691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:45.671691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:45.673420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:45.683235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 619/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Tue Jun 28 17:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:45.689101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:45.803087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:45.821900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce455c-aa1b-47a5-9392-a568d2621e39 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:45.863965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:45.865089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:45.865376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:45.865659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:45.878974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:45.880754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:45.900816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:45.901986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:45.908410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:45.908410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:45.908410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:45.908410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:45.908410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 618/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:45.908829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:46.040235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9de0b4-c3d4-452c-8248-f39443b5bcf2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:46.052256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:46.082436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:46.083120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:46.083402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:46.083667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:46.084429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:46.084748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:46.086436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:46.101004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 620/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:36:46.107420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:46.267506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4267-4c0b-47b6-b6d8-dc30ec9ca651 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:46.312453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:46.313259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:46.313580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:46.313862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:46.317120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:46.323018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:46.324520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:36:46.341969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:46.343207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:46.344140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 619/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:46.351991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:46.471143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb516a5-6c64-4c2f-80fe-004b8cfd44a4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:46.514496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:46.515724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:46.515956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:46.516287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:46.517232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:46.517609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:46.519081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:46.539920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 621/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:36:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:46.545987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:46.661554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36ecd8-7ef3-4574-8420-2699d502f595 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:46.700043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:46.700702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:46.700986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:46.701313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:46.780195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:46.785017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:46.787266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:46.916508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 620/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:36:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 28 17:36:46.922968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:46.954812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:47.037776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609c8b3-4964-45e7-855e-ed4683e2d883 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:47.083768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:47.084671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:47.084949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:47.085266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:47.098914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:47.100410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:47.123151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:47.124424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:47.130125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:47.130125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:47.130125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:47.130125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:47.130125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 622/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:47.131246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:47.246495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:47.253572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b063f83-7610-4feb-bee2-6d152172f8d6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:47.293034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:47.293798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:47.294025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:47.294302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:47.295076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:47.295356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:47.296754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:47.311236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 621/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:47.317247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:47.418764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:47.446948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d72857-4b32-4b5d-a593-779901270e7a None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:47.504433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:47.506097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:47.506484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:47.506901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:47.516290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:47.518105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:36:47.537029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:47.538102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:47.538991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 623/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:47.546230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:47.671773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd57d7-d599-4209-86b4-fa1b7f34c103 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:47.711734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:47.712441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:47.712700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:47.712976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:47.713770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:47.714115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:47.715680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f848f-d646-41f1-b6c0-9e73af18a4bc None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:47.732363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 622/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:47.745792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:47.868839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2e27-35da-4a25-a815-b5f558668867 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:47.910713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:47.911458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:47.911741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:47.912041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:47.912882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] RBAC: Adding query filter params (role.id=53846e3ec5e846a2b4f53467fb1a87e6, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=266fca3c917546fa8de7b25c77c5fd0a) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:47.913196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:47.914668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdb850-187f-4456-aefa-72fc9809d8a6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:47.923193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 624/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:36:47 2022] GET /identity/v3/role_assignments?user.id=266fca3c917546fa8de7b25c77c5fd0a&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=53846e3ec5e846a2b4f53467fb1a87e6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:50.137916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceab56-0cca-4fe2-aa60-25542923216d None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:50.138479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceab56-0cca-4fe2-aa60-25542923216d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:50.138479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eceab56-0cca-4fe2-aa60-25542923216d None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:50.140025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 623/1247] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:36:50.146026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:50.146533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:50.146631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:50.151960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:50.165342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:50.166579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:50.253280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 625/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:50.280029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceab56-0cca-4fe2-aa60-25542923216d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:50.303056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:50.413972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eceab56-0cca-4fe2-aa60-25542923216d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:50.462053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:50.463069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:50.463509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:50.463869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:50.478448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:50.488473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:50.489833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:50.491067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 624/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:50.497728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:50.638212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19b825-a4b1-43ea-8113-6e317727383c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:50.675051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:50.680772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:50.681461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:50.681737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:50.682040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:50.682791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:50.683090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:50.684456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:50.696724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 626/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:50.702849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:50.830739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:50.865817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619b963-ce09-4115-b4e2-dba21e035735 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:50.917323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:50.917711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:50.918055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:50.918395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:50.933470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:50.935283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:50.962995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:50.964152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:50.965193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:50.965193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:50.965193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:50.965193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:50.965193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 625/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:50.970620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:51.107970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a9e4-8401-47ee-bea3-f3853eac4150 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:51.156714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338231e7-3584-47cd-817a-95441669f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:51.157775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338231e7-3584-47cd-817a-95441669f03d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:51.158106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338231e7-3584-47cd-817a-95441669f03d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:51.158385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338231e7-3584-47cd-817a-95441669f03d None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:51.159316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338231e7-3584-47cd-817a-95441669f03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:51.159877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338231e7-3584-47cd-817a-95441669f03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:51.161864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338231e7-3584-47cd-817a-95441669f03d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:51.179304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 627/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:51.187837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:51.312806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7f6fa-33c1-47ee-97de-63fe534c84d7 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:51.344419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:51.356304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:51.357184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:51.357593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:51.357901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:51.367726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:51.369330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:36:51.386552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:51.388050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:51.389286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 626/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:51.394178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338231e7-3584-47cd-817a-95441669f03d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:51.466485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:51.529206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338231e7-3584-47cd-817a-95441669f03d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:51.579117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:51.579822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:51.580127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:51.580491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:51.581277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:51.581586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:51.583413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:51.603264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 628/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:36:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:51.610060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:51.742869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07825e88-fba6-4ef2-91d5-6158f54c3f21 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:51.789029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:51.789718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:51.790025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:51.790298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:51.853966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:51.870644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:51.872390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:51.998769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 627/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:36:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:36:52.005142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:52.123364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b017b-9b81-4aa3-9104-0647a25aa277 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:52.139690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:52.165693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:52.166607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:52.166954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:52.167258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:52.180382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:52.182031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:52.201441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:52.202968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:52.204368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:52.204368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:52.204368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:52.204368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:52.204368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 629/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:52.209349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:52.312751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:52.328252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda0bc-9242-4f4e-aa2a-63fcb6a8fd2d None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:52.369395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:52.370190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:52.370469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:52.370777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:52.371540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:52.371850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:52.373242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:52.389247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 628/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:52.396187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:52.529259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea99c-1e10-46c8-82c5-f4cabb1f62ac None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:52.574879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:52.575775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:52.576156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:52.576515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] PATH_INFO: `/v3/projects/service` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:52.584645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:52.586266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:36:52.601136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:52.602239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:52.603342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 630/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:52.608577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:52.724348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94addc9-964e-4339-884e-2a78fa3d624e None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:52.767021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:52.767955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:52.768372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:52.768753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:52.769911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:52.770440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:52.772844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c928188-9cc7-4457-9eba-ebbe0ba70100 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:52.790286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 629/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:36:52.796681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:52.827872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:52.920722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9545ba-e498-4759-8661-5a5d27664def None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:52.961083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:52.961762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:52.962062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:52.962364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:52.963211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=266fca3c917546fa8de7b25c77c5fd0a) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:52.963520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:52.964978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcc942-2fae-4974-ab8f-cbff24e8fa93 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:52.971274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 631/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:36:52 2022] GET /identity/v3/role_assignments?user.id=266fca3c917546fa8de7b25c77c5fd0a&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:55.055094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092fd4-83fe-43a8-9631-11bc723229a7 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.055648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092fd4-83fe-43a8-9631-11bc723229a7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.055648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092fd4-83fe-43a8-9631-11bc723229a7 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.056927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 630/1261] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:36:55.062741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.063205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.063342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.086940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:55.088143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:55.157897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 632/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:55.183973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092fd4-83fe-43a8-9631-11bc723229a7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:55.196929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:55.294250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092fd4-83fe-43a8-9631-11bc723229a7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:55.332770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:55.333618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.333902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.334208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.345537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:55.353500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:55.354655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:55.355571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 631/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:55.362793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:55.382616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:55.528118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083d9a1-da8c-4238-84da-dd5da1ecffa0 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:55.569066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:55.569742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.570042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.570321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.571134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:55.571434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:55.572834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:55.582155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 633/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:55.588215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:55.668359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:55.704177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213271-f4fd-4eb5-99f8-156ba2607bdd None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:55.744361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:55.745173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.745455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.745732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.758704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:55.760208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:55.779803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:55.780850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:55.782043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:55.782043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:55.782043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:55.782043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:55.782043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 632/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:36:55.787903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:55.879533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:55.900194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c51e9-9a9a-4a09-8bc7-2ed67bcda1e4 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:55.935535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:55.936180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:55.936459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:55.936735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:55.937456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:55.937763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:55.939175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:55.952117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 634/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:55.958277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.063388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2cbce-3b1e-415a-9e8c-7f91d5ad5ba2 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.084211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:56.099842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.100664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.100944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.101220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.108990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.110494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:36:56.124706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:56.125757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:56.126934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 633/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:56.132092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.235275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4479ab-3234-471d-89df-35ce2b17745b None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.270355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.271026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.271301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.271578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.272399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:56.272709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.274159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.282979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:56.292537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 635/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:36:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:56.298658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.405647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50195910-60fa-466a-b8b5-15af2eb442f4 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.441186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.442127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.442493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.442841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.456106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.457833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:56.478462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:56.479456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:56.480338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:56.480338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:56.480338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:56.480338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:56.480338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 634/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:56.486199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.587656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36503c4-4548-4bf6-971d-1d4fe4cd66e6 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.624132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.624790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.625069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.625344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.630374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:56.630374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.630374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.639347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 636/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:56.646165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.681779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:56.755242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d02f6-f3b8-4559-8d7c-c5f17c264825 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.794184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.794998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.795276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.795545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.804219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.805695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:36:56.821390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:56.822569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:36:56.823611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 635/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:56.828929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:56.891708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:56.934240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b9b97-80b3-4d54-9810-0cad03d59667 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:56.969652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:56.970353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:56.970604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:56.970909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:56.971691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:56.971993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:56.973673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726efaa4-1e38-4972-be1a-8d5c70c4bbea None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:56.986334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 637/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:56.992724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:57.088406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:57.097978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9fe4d-2fd5-48ad-afe0-15f884dd44d6 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:57.133080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:57.133984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:57.134272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:57.134552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] PATH_INFO: `/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/266fca3c917546fa8de7b25c77c5fd0a/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:57.136588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0a9fd43ae94fee912726ba7688be82, user_id=266fca3c917546fa8de7b25c77c5fd0a, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:57.138059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2872c30-efa7-4543-a2fa-fca0ec504874 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:57.152187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 636/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Tue Jun 28 17:36:56 2022] PUT /identity/v3/projects/2e0a9fd43ae94fee912726ba7688be82/users/266fca3c917546fa8de7b25c77c5fd0a/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:36:59.169313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5435-063d-41da-97ef-abf24cbddeb7 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.169923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5435-063d-41da-97ef-abf24cbddeb7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.169923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae5435-063d-41da-97ef-abf24cbddeb7 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.171247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 638/1274] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:36:59.176963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.177524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.177524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.194842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:36:59.196029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:36:59.267412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 637/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:36:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:36:59.291310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae5435-063d-41da-97ef-abf24cbddeb7 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:59.399261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae5435-063d-41da-97ef-abf24cbddeb7 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:59.416771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:59.436444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:59.437170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.437447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.437718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.448614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 28 17:36:59.456591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:59.457730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:59.459119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 639/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Tue Jun 28 17:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:59.464262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:59.547145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:36:59.566445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0682b-839a-4af4-9696-2f9550661245 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:59.601800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:59.602493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.602771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.603048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.603769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:59.604074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:59.605445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:59.613813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 638/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Tue Jun 28 17:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:59.619740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:59.721892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce99cf64-13ae-42ca-8ced-4af7f2d455a8 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:59.760028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:59.760833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.761109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.761377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.774305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:59.775778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:36:59.794723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:36:59.795700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:36:59.796689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:36:59.796689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:36:59.796689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:36:59.796689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:36:59.796689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 640/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:36:59.802545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:59.906097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312b85-4446-4b1a-a960-52c671708a11 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:36:59.941609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:36:59.942309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:36:59.942591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:36:59.942865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:36:59.943583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:36:59.943887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:36:59.945264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:36:59.957396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 639/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:36:59.963356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:36:59.995281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:00.068439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb4800-c4a5-47c5-8480-264c73e9dc36 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:00.105457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:00.106300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:00.106576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:00.106840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:00.114363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:00.115803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 28 17:37:00.130700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:00.131837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:00.133091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 641/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:36:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:37:00.138556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:00.143370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:00.253054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e562-f90c-477c-8c00-97e48f047d7c None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:00.288378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:00.289054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:00.289333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:00.289610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:00.290481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:00.290783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:00.292220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:00.309922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 640/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Jun 28 17:37:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:00.315903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:00.419633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:00.430561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed49b8-8d24-4030-821e-8a3348344947 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:00.469157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:00.469814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:00.470126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:00.470406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:00.540121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:00.541478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:00.655681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:00.670425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 642/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Tue Jun 28 17:37:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 28 17:37:00.677360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:00.745709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:00.793464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d004a4-e1d7-426e-a198-474a8f8bd40f None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:00.833194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:00.834025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:00.834314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:00.834614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:00.845426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:00.846929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 28 17:37:00.865165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:00.866234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:00.867268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 28 17:37:00.867268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 28 17:37:00.867268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 28 17:37:00.867268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:37:00.867268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 641/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:37:00.873878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:01.003854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e36979-deef-40b6-b9e8-d42a6bc156b1 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:01.045787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:01.046407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:01.046686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:01.046954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:01.047683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:01.048135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:01.051109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:01.066261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 643/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Tue Jun 28 17:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:01.072330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:01.184982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf611e-37dc-412c-8b71-475487fb18db None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:01.199580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:01.221664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:01.222499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:01.222781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:01.223048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:01.230285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:01.231738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 28 17:37:01.246509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:01.247588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: ERROR keystone.server.flask.application Jun 28 17:37:01.248669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 642/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Tue Jun 28 17:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:37:01.253990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:01.308523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:01.359028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae8a4-a89b-48a9-a88a-b220762f8b9d None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:01.399994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:01.400676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:01.400955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:01.401235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:01.402056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:01.402366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:01.403805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c6495-fb98-4777-8a0e-2838da7a62c3 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:01.416857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 644/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Tue Jun 28 17:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:37:01.423305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:01.529250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb832c0-38d9-4e79-9131-82db5e17efe9 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:01.564298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:01.564869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:01.565157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:01.565424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:01.566288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] RBAC: Adding query filter params (role.id=dd1ee2044a264c889a54729a0b3f69ea, scope.project.id=2e0a9fd43ae94fee912726ba7688be82, user.id=266fca3c917546fa8de7b25c77c5fd0a) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:01.566631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:01.568097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546558bb-05d8-4e12-924f-641c6a890856 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:01.574094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 643/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Tue Jun 28 17:37:01 2022] GET /identity/v3/role_assignments?user.id=266fca3c917546fa8de7b25c77c5fd0a&scope.project.id=2e0a9fd43ae94fee912726ba7688be82&role.id=dd1ee2044a264c889a54729a0b3f69ea => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:03.627182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f8b8-a114-49f4-a8ac-cf130aa7fb28 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:03.627807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f8b8-a114-49f4-a8ac-cf130aa7fb28 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:03.627807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42f8b8-a114-49f4-a8ac-cf130aa7fb28 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:03.629114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 645/1288] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:37:03.635226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:03.635773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:03.635773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:03.655196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:37:03.656554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:37:03.692302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:03.734742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 644/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:37:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:37:03.758598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f8b8-a114-49f4-a8ac-cf130aa7fb28 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:03.866186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42f8b8-a114-49f4-a8ac-cf130aa7fb28 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:03.877578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:03.906290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:03.907075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:03.907353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:03.907630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:03.908286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:03.909692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:03.922536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:03.923709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:03.925051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 646/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:37:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:37:03.930704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:04.042766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb6a5-bf78-4b07-9662-01033b778cd4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:04.079361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:04.080029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:04.080310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:04.080582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:04.081294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:04.081595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:04.083176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589115b-89cf-4c51-b786-c201cd31f20f None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:04.089715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 645/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Jun 28 17:37:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:04.095747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:04.200469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55c257-2890-4b68-ba10-4deb3294b0a2 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:04.236411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:04.237214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:04.237679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:04.238084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] PATH_INFO: `/v3/services` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:04.239164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] RBAC: Adding query filter params (type=placement) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:04.239514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:04.240978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed660d-cf57-4fb9-88c2-0065c373741f None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:04.247557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 647/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Jun 28 17:37:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:06.337436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077377-3508-4069-ace8-28edfa16a808 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:06.338034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077377-3508-4069-ace8-28edfa16a808 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:06.338034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077377-3508-4069-ace8-28edfa16a808 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:06.339406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 646/1293] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:37:06.345258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18ae3-9ac3-4ec5-b947-05442a0e4d16 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:06.345746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18ae3-9ac3-4ec5-b947-05442a0e4d16 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:06.345833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e18ae3-9ac3-4ec5-b947-05442a0e4d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:06.365834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-22e18ae3-9ac3-4ec5-b947-05442a0e4d16 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:37:06.367156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-22e18ae3-9ac3-4ec5-b947-05442a0e4d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:37:06.401506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:06.443729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 648/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:37:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:37:06.471494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077377-3508-4069-ace8-28edfa16a808 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:06.522425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:06.623422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077377-3508-4069-ace8-28edfa16a808 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:06.659298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:06.659967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:06.660249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:06.660801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:06.661624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:06.663047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3a8af-fe3c-4f9c-9206-b68581a4b68b None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:06.678883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 647/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Tue Jun 28 17:37:06 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:37:08.747588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530746b-a0cd-4bba-ba49-5f7cd70653d1 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:08.748241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530746b-a0cd-4bba-ba49-5f7cd70653d1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:08.748241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530746b-a0cd-4bba-ba49-5f7cd70653d1 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:08.749510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 649/1296] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:37:08.758478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:08.759163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:08.759163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:08.781424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:37:08.782523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:37:08.861018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 648/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:37:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:37:08.894079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530746b-a0cd-4bba-ba49-5f7cd70653d1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:09.005277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530746b-a0cd-4bba-ba49-5f7cd70653d1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:09.041458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:09.042309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:09.042583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:09.042854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:09.043505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:09.044880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:09.058024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:09.059379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:09.060317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 650/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:37:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 28 17:37:09.066824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:09.088547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:09.184027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5fdac-af9f-4b6b-9d27-eed6c561eb36 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:09.223612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:09.224317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:09.224701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:09.224946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:09.225681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:09.226103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:09.227665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:09.234623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 649/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Jun 28 17:37:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:09.244023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:09.290427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:09.392790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a6dd3-2e10-415d-927c-5c173819c276 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:09.446820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:09.447692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:09.447928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:09.448209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:09.449008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] RBAC: Adding query filter params (interface=public, service_id=335913eb16974de3b961969230eb2db7, region_id=RegionOne) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:09.449452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:09.450942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0c05d-31a4-48c0-ba76-70ed17719344 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:09.458334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 651/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Tue Jun 28 17:37:09 2022] GET /identity/v3/endpoints?service_id=335913eb16974de3b961969230eb2db7&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:37:09.465263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:09.585239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:09.605863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe09491-ddb9-4891-9ab6-e4c3a27a30d0 None admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:09.653317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:09.654113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:09.654389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:09.654709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:09.655488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:09.657113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f26717-340b-42c0-8a43-a4bcd5870214 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:09.668346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 650/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Tue Jun 28 17:37:09 2022] GET /identity/v3/services => generated 2191 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:37:11.733966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0a697-f7e9-45f5-b105-f58d7592095d None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:11.734580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0a697-f7e9-45f5-b105-f58d7592095d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:11.734715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0a697-f7e9-45f5-b105-f58d7592095d None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:11.736113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 652/1302] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:37:11.742553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:11.743048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:11.743202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:11.764560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:37:11.765790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:37:11.849409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 651/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:37:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 28 17:37:11.874126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0a697-f7e9-45f5-b105-f58d7592095d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:11.999346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:12.007446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0a697-f7e9-45f5-b105-f58d7592095d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:12.058543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:12.059668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:12.060187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:12.060588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:12.061505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:12.063451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 28 17:37:12.078857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 28 17:37:12.080162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.get_or_create( Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application with Lock( Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self._enter() Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application return self.creator() Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application created_value = creator( Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: ERROR keystone.server.flask.application Jun 28 17:37:12.081040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 653/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Jun 28 17:37:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 28 17:37:12.088591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:12.190678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:12.226660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f7bcf-d9f8-4a9c-86aa-2641533da492 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:12.274144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:12.274742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:12.275020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:12.275294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] PATH_INFO: `/v3/services` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:12.276012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:37:12.276362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:12.277755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b76d-e936-4aa7-b374-6f92c084bd53 None admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:12.283712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 652/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Tue Jun 28 17:37:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:37:12.289956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:37:12.398090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f05d9f-324e-4c48-81ee-ac4a4746bd79 None admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:37:12.439983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:37:12.440664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:37:12.440949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:37:12.441225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:37:12.442125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:37:12.443810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec832ff3-760e-45ef-9d75-6b6e9da934c7 None admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:37:12.465407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 654/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Tue Jun 28 17:37:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:37:22.280312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=30 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:37:22.460589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:18.815913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa5a7-74f2-4a2b-b90a-1b949afe122f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:18.816389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa5a7-74f2-4a2b-b90a-1b949afe122f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:18.816634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa5a7-74f2-4a2b-b90a-1b949afe122f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:18.824410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4827-0386-42bc-ab01-feb4663b303a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:18.825006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4827-0386-42bc-ab01-feb4663b303a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:18.825006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca4827-0386-42bc-ab01-feb4663b303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:18.828565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 653/1307] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:18.938381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-02ca4827-0386-42bc-ab01-feb4663b303a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:18.939631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-02ca4827-0386-42bc-ab01-feb4663b303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:19.073702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 655/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:19.131977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:19.132262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:19.132751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:19.136878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 654/1309] 10.222.0.48 () {54 vars in 964 bytes} [Tue Jun 28 17:38:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:19.145600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e623734-6751-4dba-9918-fadd66d8aa1a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:19.146414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e623734-6751-4dba-9918-fadd66d8aa1a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:19.147958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e623734-6751-4dba-9918-fadd66d8aa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:19.237750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8e623734-6751-4dba-9918-fadd66d8aa1a None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:19.239351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8e623734-6751-4dba-9918-fadd66d8aa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:19.267740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:19.338231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 656/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Jun 28 17:38:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:19.346511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:19.348685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:19.475759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0711e1a-a87e-406b-80a1-d2dbbb850c8b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:19.566781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:19.568038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:19.568695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:19.569192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:19.571183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:19.635088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:19.699944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:19.701522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a622548-a6aa-4f6a-a3ff-7f3a6679d3c0 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:19.742278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 655/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:22.281523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:22.282137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:22.282137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:22.283542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 657/1312] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:22.290272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080d69-e0a7-4af5-b41f-ebdd399e5caa None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:22.290978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080d69-e0a7-4af5-b41f-ebdd399e5caa None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:22.290978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080d69-e0a7-4af5-b41f-ebdd399e5caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:22.371850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-30080d69-e0a7-4af5-b41f-ebdd399e5caa None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:22.373111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-30080d69-e0a7-4af5-b41f-ebdd399e5caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:22.480739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 656/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:22.520225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:22.522503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:22.637964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f8dcd-7cbf-4ef1-b0c8-991b066fc6db None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:22.722822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:22.726062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:22.726707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:22.726996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:22.727371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:22.729668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:22.852734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:22.854228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed289b1-5aa9-420b-835d-328500778e80 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:22.874420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 658/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:25.278623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7cab-a7f0-4751-8c33-77d104d3b925 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:25.279224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7cab-a7f0-4751-8c33-77d104d3b925 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:25.279224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7cab-a7f0-4751-8c33-77d104d3b925 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:25.280556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 657/1315] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:25.286418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2af3-c17f-4ebf-b9dc-94a6b97f170d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:25.286944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2af3-c17f-4ebf-b9dc-94a6b97f170d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:25.286944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d2af3-c17f-4ebf-b9dc-94a6b97f170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:25.355334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9b6d2af3-c17f-4ebf-b9dc-94a6b97f170d None None] MFA Rules not processed for user `da0681f3e0df4db8a4c6beee6310e04c`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:25.356558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9b6d2af3-c17f-4ebf-b9dc-94a6b97f170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:25.410614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:25.457562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 659/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:25.509674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:25.509933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:25.510275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:25.511679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 658/1317] 10.222.0.48 () {54 vars in 964 bytes} [Tue Jun 28 17:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:25.517932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680d20-5f6c-47ad-987f-565b107816fb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:25.518252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680d20-5f6c-47ad-987f-565b107816fb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:25.518526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2680d20-5f6c-47ad-987f-565b107816fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:25.599651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d2680d20-5f6c-47ad-987f-565b107816fb None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:25.600794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d2680d20-5f6c-47ad-987f-565b107816fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:25.679289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 660/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Tue Jun 28 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:25.688458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:25.690041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:25.700168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:25.802471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c178-a32b-4551-bb64-de7e59fb7d96 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:25.878843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:25.879407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:25.879690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:25.879973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:25.881642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:25.947370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:25.997411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:25.998912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f5d11-250c-42d6-9b14-9294b3c45745 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:26.018464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 659/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:29.034384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:29.034916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:29.034916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:29.036172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 661/1320] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:29.042408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b60cb-662f-486a-9519-a2385ae6f65a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:29.042846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b60cb-662f-486a-9519-a2385ae6f65a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:29.042954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b60cb-662f-486a-9519-a2385ae6f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:29.116577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-891b60cb-662f-486a-9519-a2385ae6f65a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:29.117826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-891b60cb-662f-486a-9519-a2385ae6f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:29.220394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 660/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:29.261035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:29.262671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:29.321598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:29.380595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd97fd-1874-47a6-b366-170f16898bf4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:29.470990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:29.471637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:29.471919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:29.472191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:29.474319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:29.585595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:29.600683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:29.602186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b19d6-f3b1-4aa8-8c9d-22c235ce829c service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:29.621376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 662/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:32.493369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:32.493928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:32.493928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:32.495351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 661/1323] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:32.501101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c8d9-2059-4bcd-a646-3be29ffbce7b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:32.501588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c8d9-2059-4bcd-a646-3be29ffbce7b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:32.501748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72c8d9-2059-4bcd-a646-3be29ffbce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:32.576538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4d72c8d9-2059-4bcd-a646-3be29ffbce7b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:32.577731 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4d72c8d9-2059-4bcd-a646-3be29ffbce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:32.688198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 663/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:32.727082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:32.728637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:32.751986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:32.879120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a50f4-dd38-4f44-b865-69ee4078a197 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:32.961001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:32.961583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:32.961872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:32.962173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:32.963906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:33.043905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:33.096258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:33.097640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e9612-6265-4cf4-895b-13003fc65b71 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:33.119635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 662/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:38:35.316430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:35.316968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:35.316968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:35.319097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 664/1326] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:35.324870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8925-8a69-4493-87ec-9ace8bd53f86 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:35.325382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8925-8a69-4493-87ec-9ace8bd53f86 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:35.325512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8925-8a69-4493-87ec-9ace8bd53f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:35.399207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-af5e8925-8a69-4493-87ec-9ace8bd53f86 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:35.400458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-af5e8925-8a69-4493-87ec-9ace8bd53f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:35.512547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 663/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:35.548726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:35.550869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:35.616925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:35.669221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09427d64-5f21-4711-9507-1cc174c2725b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:35.748309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:35.748963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:35.749241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:35.749511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:35.751201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:35.884974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:35.887663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:35.889175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27de41-eb59-4fdf-976f-a061bc306a1f service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:35.909846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 665/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:38.039158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734da0-9815-478f-8412-85f457d71e31 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:38.039746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734da0-9815-478f-8412-85f457d71e31 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:38.039746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97734da0-9815-478f-8412-85f457d71e31 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:38.041274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 664/1329] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:38.047023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689db8a-35d0-4061-afe0-5dd0cc3bd521 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:38.047538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689db8a-35d0-4061-afe0-5dd0cc3bd521 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:38.047627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689db8a-35d0-4061-afe0-5dd0cc3bd521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:38.128777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2689db8a-35d0-4061-afe0-5dd0cc3bd521 None None] MFA Rules not processed for user `da0681f3e0df4db8a4c6beee6310e04c`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:38.130021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2689db8a-35d0-4061-afe0-5dd0cc3bd521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:38.235252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 666/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:38.279446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734da0-9815-478f-8412-85f457d71e31 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:38.281241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-97734da0-9815-478f-8412-85f457d71e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:38.316938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:38.398473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97734da0-9815-478f-8412-85f457d71e31 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:38.499868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:38.501321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:38.501321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:38.501614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:38.503189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:38.595671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:38.632520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:38.634013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88641dae-304a-434b-9236-b5a37b536c18 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:38.654588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 665/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:41.036782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:41.037360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:41.037567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:41.038974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 667/1332] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:41.044711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348df7-de48-428a-ace5-fcf06e924455 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:41.045189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348df7-de48-428a-ace5-fcf06e924455 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:41.045324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af348df7-de48-428a-ace5-fcf06e924455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:41.113801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-af348df7-de48-428a-ace5-fcf06e924455 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:41.115169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-af348df7-de48-428a-ace5-fcf06e924455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:41.229415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 666/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:41.266875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:41.268470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:41.350111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:41.386854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da65b-af4b-4258-b18e-af71582683f6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:41.464905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:41.465572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:41.465853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:41.466157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:41.467847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:41.587928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:41.589396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1253b8-5954-4adc-9aad-c3ab56c9b509 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:41.600567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:41.611723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 668/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:43.737318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:43.737871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:43.738295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:43.740211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 667/1335] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:43.746363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeab40-c175-482d-8b4c-51392dbb2e76 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:43.746914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeab40-c175-482d-8b4c-51392dbb2e76 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:43.746914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeab40-c175-482d-8b4c-51392dbb2e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:43.820610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8fdeab40-c175-482d-8b4c-51392dbb2e76 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:43.821863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8fdeab40-c175-482d-8b4c-51392dbb2e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:43.927438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 669/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:43.968769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:43.970515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:44.020923 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:44.094054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542730de-0eb5-4d4c-8227-ce8ffa4adddd None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:44.175710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:44.176372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:44.176678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:44.177016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:44.179516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:44.283297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:44.316122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:44.317856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8f5aad-416e-42af-8a4e-e9f327322e1f service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:44.342087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 668/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:46.905408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:46.906033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:46.906033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:46.907344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 670/1338] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:46.913363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848b9e-4bd7-41e3-b4af-c71f8964dae1 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:46.913882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848b9e-4bd7-41e3-b4af-c71f8964dae1 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:46.913882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c848b9e-4bd7-41e3-b4af-c71f8964dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:46.987494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6c848b9e-4bd7-41e3-b4af-c71f8964dae1 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:46.988712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6c848b9e-4bd7-41e3-b4af-c71f8964dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:47.105824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 669/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:47.147017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:47.148594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:47.232819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:47.263917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d81d39-717c-41be-a0f8-de0a4c49ce20 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:47.347686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:47.348371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:47.348649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:47.349119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:47.350981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:47.487550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:47.488988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0377e37-96e3-4f80-8971-3cfc9fc5fae4 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:47.509982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 671/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:51.728470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:51.729043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:51.729043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:51.730492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 670/1341] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:51.736273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0765-eeb8-4d29-8ff8-128db085ceef None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:51.736888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0765-eeb8-4d29-8ff8-128db085ceef None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:51.736888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b0765-eeb8-4d29-8ff8-128db085ceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:51.744303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:51.833363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-550b0765-eeb8-4d29-8ff8-128db085ceef None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:51.834770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-550b0765-eeb8-4d29-8ff8-128db085ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:51.972807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 672/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:52.015557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:52.022860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:52.089264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:38:52.151756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415584e-ae22-4ffa-84a3-51c14195cfa3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:52.156158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:52.156876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:52.157156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:52.157436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:52.168106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:52.169595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d98b5f-7f9a-4ca1-96d2-3f8de5aa2a7c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:52.181410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 671/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:38:54.963526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:54.964117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:54.964117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:54.965543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 673/1344] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:38:54.971537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dd43-5a14-4941-8ad6-0303b5c92198 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:54.972023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dd43-5a14-4941-8ad6-0303b5c92198 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:54.972644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4dd43-5a14-4941-8ad6-0303b5c92198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:55.001331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-36f4dd43-5a14-4941-8ad6-0303b5c92198 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:38:55.002561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-36f4dd43-5a14-4941-8ad6-0303b5c92198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:55.098590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 672/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:38:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:38:55.137288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:38:55.139880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:38:55.155908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e5528-1ed2-4f0f-9a7d-6f224f1ebdbb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:38:55.160605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:38:55.161349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:38:55.161637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:38:55.162114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:38:55.172870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:38:55.174404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e975c-b7db-4dee-9770-656ffe99bce4 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:38:55.186549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 674/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:38:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:39:00.832557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453804ae-77f6-4aab-9498-935cccf185dc None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:00.833297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453804ae-77f6-4aab-9498-935cccf185dc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:00.833521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453804ae-77f6-4aab-9498-935cccf185dc None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:00.837051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 673/1347] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:00.842844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a858-e707-4609-8c16-0bba184fa760 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:00.843468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a858-e707-4609-8c16-0bba184fa760 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:00.843468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a858-e707-4609-8c16-0bba184fa760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:00.862850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0227a858-e707-4609-8c16-0bba184fa760 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:00.864189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0227a858-e707-4609-8c16-0bba184fa760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:00.879891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 675/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:00.922073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453804ae-77f6-4aab-9498-935cccf185dc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:00.934746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453804ae-77f6-4aab-9498-935cccf185dc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:00.938897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:00.939940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:00.940379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:00.940786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:00.956492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:00.958881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7347acf-9bae-49d9-9208-e57bc5612054 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:00.970838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 674/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:06.396165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f8c7-b507-4298-8a84-dcab383c1f80 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:06.396725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f8c7-b507-4298-8a84-dcab383c1f80 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:06.397087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f8c7-b507-4298-8a84-dcab383c1f80 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:06.400028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 676/1350] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:39:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:06.407726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205888-9f76-4836-b5a9-3acc371d2211 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:06.408450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205888-9f76-4836-b5a9-3acc371d2211 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:06.408450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205888-9f76-4836-b5a9-3acc371d2211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:06.494346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-13205888-9f76-4836-b5a9-3acc371d2211 None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:06.495550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-13205888-9f76-4836-b5a9-3acc371d2211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:06.528579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:06.602213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 675/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:39:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:10.857882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=72 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:11.681610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560a7a-6556-46f5-84c9-d17864007d50 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:11.682335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560a7a-6556-46f5-84c9-d17864007d50 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:11.682844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71560a7a-6556-46f5-84c9-d17864007d50 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:11.684473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 677/1352] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:11.690267 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752fe1-aa22-41d8-bd39-437f179da386 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:11.690800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752fe1-aa22-41d8-bd39-437f179da386 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:11.690940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c752fe1-aa22-41d8-bd39-437f179da386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:11.712261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4c752fe1-aa22-41d8-bd39-437f179da386 None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:11.713546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4c752fe1-aa22-41d8-bd39-437f179da386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:11.730528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 676/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:39:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:13.021535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc343ee-5eb7-4004-a2e6-fd22ab36028f None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:13.021535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc343ee-5eb7-4004-a2e6-fd22ab36028f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:13.021535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc343ee-5eb7-4004-a2e6-fd22ab36028f None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:13.023546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 678/1354] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:39:13.029269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f150b-4e28-4cda-81a3-4199bcc6221e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:13.029797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f150b-4e28-4cda-81a3-4199bcc6221e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:13.029797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f150b-4e28-4cda-81a3-4199bcc6221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:13.049794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1d6f150b-4e28-4cda-81a3-4199bcc6221e None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:13.051462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1d6f150b-4e28-4cda-81a3-4199bcc6221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:13.060807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 677/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:39:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:17.087335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b365cd-7b73-4130-b622-8ddcbe8a2ec9 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:17.087928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b365cd-7b73-4130-b622-8ddcbe8a2ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:17.087928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b365cd-7b73-4130-b622-8ddcbe8a2ec9 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:17.089254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 679/1356] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:17.095650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faccf1-1e4c-4c97-b991-11da5ff8f207 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:17.096395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faccf1-1e4c-4c97-b991-11da5ff8f207 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:17.096395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faccf1-1e4c-4c97-b991-11da5ff8f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:17.124323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-66faccf1-1e4c-4c97-b991-11da5ff8f207 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:17.125563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-66faccf1-1e4c-4c97-b991-11da5ff8f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:17.137292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 678/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:17.228945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea4f6-fbba-4386-87a5-0dd8ebcaa95c None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:17.229253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea4f6-fbba-4386-87a5-0dd8ebcaa95c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:17.229511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ea4f6-fbba-4386-87a5-0dd8ebcaa95c None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:17.233709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 680/1358] 10.222.0.48 () {54 vars in 961 bytes} [Tue Jun 28 17:39:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:17.250285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af537-9108-41e4-bbed-e16d71eccac4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:17.250454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af537-9108-41e4-bbed-e16d71eccac4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:17.250673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af537-9108-41e4-bbed-e16d71eccac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:17.347571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c39af537-9108-41e4-bbed-e16d71eccac4 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:17.349679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c39af537-9108-41e4-bbed-e16d71eccac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:17.495627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 679/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Jun 28 17:39:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:17.504140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea4f6-fbba-4386-87a5-0dd8ebcaa95c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:17.520070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ea4f6-fbba-4386-87a5-0dd8ebcaa95c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:17.526237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:17.527050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:17.527333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:17.527608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:17.537155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:17.538953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa81fd-256f-49ca-9bfd-bf457acf3147 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:17.549978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 681/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:20.201835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0be15-ab11-460e-952d-b9ddf3860c98 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:20.202377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0be15-ab11-460e-952d-b9ddf3860c98 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:20.202481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0be15-ab11-460e-952d-b9ddf3860c98 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:20.203953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 680/1361] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:20.209265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce276186-b772-4103-a407-aaad651decf3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:20.210185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce276186-b772-4103-a407-aaad651decf3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:20.210185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce276186-b772-4103-a407-aaad651decf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:20.228284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ce276186-b772-4103-a407-aaad651decf3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:20.229486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ce276186-b772-4103-a407-aaad651decf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:20.237563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 682/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:20.288112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0be15-ab11-460e-952d-b9ddf3860c98 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:20.314821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0be15-ab11-460e-952d-b9ddf3860c98 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:20.324075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:20.325065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:20.325492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:20.325908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:20.341241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:20.343905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198be6f5-3aa3-4b4f-9699-53aae2fe8faa service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:20.360652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 681/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:23.119567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3822-000d-47ad-bd9b-a8af78ffd027 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:23.120313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3822-000d-47ad-bd9b-a8af78ffd027 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:23.120313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3822-000d-47ad-bd9b-a8af78ffd027 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:23.121336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 683/1364] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:23.127701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b33d9-f0e0-4cd8-9267-b9982fceb7c7 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:23.128251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b33d9-f0e0-4cd8-9267-b9982fceb7c7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:23.128251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b33d9-f0e0-4cd8-9267-b9982fceb7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:23.148501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-bc5b33d9-f0e0-4cd8-9267-b9982fceb7c7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:23.149740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bc5b33d9-f0e0-4cd8-9267-b9982fceb7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:23.158059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 682/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:23.207272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61558-4977-4125-ae37-ca9ee5b4f310 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:23.207693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61558-4977-4125-ae37-ca9ee5b4f310 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:23.208085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee61558-4977-4125-ae37-ca9ee5b4f310 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:23.212407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 684/1366] 10.222.0.48 () {54 vars in 961 bytes} [Tue Jun 28 17:39:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:23.222225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420416-dde6-400f-b40a-94d753aac61c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:23.222477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420416-dde6-400f-b40a-94d753aac61c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:23.222765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b420416-dde6-400f-b40a-94d753aac61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:23.243560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7b420416-dde6-400f-b40a-94d753aac61c None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:23.244795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7b420416-dde6-400f-b40a-94d753aac61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:23.255354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 683/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Jun 28 17:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:23.264241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61558-4977-4125-ae37-ca9ee5b4f310 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:23.279730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee61558-4977-4125-ae37-ca9ee5b4f310 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:23.285312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:23.286014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:23.286302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:23.286674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:23.296439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:23.298087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de20ec-46aa-4ce1-a3ca-8951e258e251 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:23.309682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 685/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:25.535984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc968-8677-4b2e-808f-152146cd8e43 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:25.536711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc968-8677-4b2e-808f-152146cd8e43 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:25.536711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc968-8677-4b2e-808f-152146cd8e43 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:25.538443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 684/1369] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:39:25.546377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748de0d-29b0-4d6d-b7b1-d9f92995c8bd None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:25.546893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748de0d-29b0-4d6d-b7b1-d9f92995c8bd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:25.547250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748de0d-29b0-4d6d-b7b1-d9f92995c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:25.567085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0748de0d-29b0-4d6d-b7b1-d9f92995c8bd None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:25.568418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0748de0d-29b0-4d6d-b7b1-d9f92995c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:25.576964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 686/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:25.622567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc968-8677-4b2e-808f-152146cd8e43 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:25.638941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc968-8677-4b2e-808f-152146cd8e43 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:25.645545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:25.646492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:25.646847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:25.647192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:25.656810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:25.658554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed317026-bf20-44bb-bd88-4a00099167e7 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:25.669509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 685/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:26.703793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99c82-e411-4d2e-9d12-650a75dbdefe None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:26.704342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99c82-e411-4d2e-9d12-650a75dbdefe None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:26.704508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b99c82-e411-4d2e-9d12-650a75dbdefe None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:26.706663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 687/1372] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:26.714530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe417-d799-48fa-8055-f4a3f4a949e8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:26.715130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe417-d799-48fa-8055-f4a3f4a949e8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:26.715130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fe417-d799-48fa-8055-f4a3f4a949e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:26.736315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5d9fe417-d799-48fa-8055-f4a3f4a949e8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:26.737991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5d9fe417-d799-48fa-8055-f4a3f4a949e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:26.749630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 686/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:27.115509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb62f-76e8-4966-9ab0-d2ea8a252e89 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.115841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb62f-76e8-4966-9ab0-d2ea8a252e89 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.116360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb62f-76e8-4966-9ab0-d2ea8a252e89 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.117873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 688/1374] 10.222.0.48 () {54 vars in 963 bytes} [Tue Jun 28 17:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:39:27.123876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac71a0-2c0b-4f15-ae4c-48616a4ce752 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.124228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac71a0-2c0b-4f15-ae4c-48616a4ce752 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.124555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac71a0-2c0b-4f15-ae4c-48616a4ce752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.132137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:27.185116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-d3ac71a0-2c0b-4f15-ae4c-48616a4ce752 None None] MFA Rules not processed for user `5fabfc6086e244db994a4bbbbbdfc5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:27.186597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d3ac71a0-2c0b-4f15-ae4c-48616a4ce752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:27.270303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 687/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Jun 28 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:27.272996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb62f-76e8-4966-9ab0-d2ea8a252e89 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:27.289934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb62f-76e8-4966-9ab0-d2ea8a252e89 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:27.295062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:27.295833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.296320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.296590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.308897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:27.310449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26cee3-f9a7-4c73-884e-afdeeb59eed9 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:27.321551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 689/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:27.839315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991539bf-6cb8-4bea-8f2d-ca6f1ffc1f05 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.839913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991539bf-6cb8-4bea-8f2d-ca6f1ffc1f05 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.839913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991539bf-6cb8-4bea-8f2d-ca6f1ffc1f05 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.841518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 688/1377] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:27.847521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ba26-9c43-49b5-a04a-4cd33d2a3394 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.848029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ba26-9c43-49b5-a04a-4cd33d2a3394 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.848261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ba26-9c43-49b5-a04a-4cd33d2a3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.868330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4070ba26-9c43-49b5-a04a-4cd33d2a3394 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:27.869629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4070ba26-9c43-49b5-a04a-4cd33d2a3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:27.877990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 690/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:27.935359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991539bf-6cb8-4bea-8f2d-ca6f1ffc1f05 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:27.959031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991539bf-6cb8-4bea-8f2d-ca6f1ffc1f05 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:27.966294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:27.967170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:27.968115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:27.968605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:27.984989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:27.988732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf01024-aaf4-4f26-b0ad-c2849b886b43 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:28.009328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 689/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:30.215517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c064bf-9fb6-44b7-abbd-15fafd5dc1fa None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:30.216074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c064bf-9fb6-44b7-abbd-15fafd5dc1fa None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:30.216074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c064bf-9fb6-44b7-abbd-15fafd5dc1fa None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:30.217518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 691/1380] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:30.223562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6de3-9216-4e73-b62f-c2249b3712b6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:30.224030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6de3-9216-4e73-b62f-c2249b3712b6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:30.224177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6de3-9216-4e73-b62f-c2249b3712b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:30.244616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-853a6de3-9216-4e73-b62f-c2249b3712b6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:30.246964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-853a6de3-9216-4e73-b62f-c2249b3712b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:30.258162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 690/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:30.309202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c064bf-9fb6-44b7-abbd-15fafd5dc1fa None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:30.333006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c064bf-9fb6-44b7-abbd-15fafd5dc1fa None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:30.339653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:30.340540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:30.340817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:30.341233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:30.351093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:30.353086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51332a89-cd73-4d4b-9b1c-ed16234a0f27 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:30.366020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 692/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:32.547018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b779a-afb8-4b16-991e-b57ed90e74d3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:32.547848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b779a-afb8-4b16-991e-b57ed90e74d3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:32.547848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b779a-afb8-4b16-991e-b57ed90e74d3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:32.550302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 691/1383] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:32.555314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaab3d-1283-4903-82cc-55a4cb1a5343 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:32.556173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaab3d-1283-4903-82cc-55a4cb1a5343 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:32.556441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaab3d-1283-4903-82cc-55a4cb1a5343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:32.576638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9eeaab3d-1283-4903-82cc-55a4cb1a5343 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:32.577831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9eeaab3d-1283-4903-82cc-55a4cb1a5343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:32.586653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 693/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:32.630809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b779a-afb8-4b16-991e-b57ed90e74d3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:32.655628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b779a-afb8-4b16-991e-b57ed90e74d3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:32.663903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:32.664882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:32.665302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:32.665720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:32.680156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:32.683066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270e8a3-a745-4ef7-a369-7fb86632d71c service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:32.702320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 692/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:34.987048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536903-9d69-4320-b5f3-4b2bb4327879 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:34.987992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536903-9d69-4320-b5f3-4b2bb4327879 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:34.987992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39536903-9d69-4320-b5f3-4b2bb4327879 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:34.989260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 694/1386] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:39:35.000402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203327f3-63fe-4a78-b443-dbbb5bd9ea3f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:35.000978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203327f3-63fe-4a78-b443-dbbb5bd9ea3f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:35.001339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203327f3-63fe-4a78-b443-dbbb5bd9ea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:35.035906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-203327f3-63fe-4a78-b443-dbbb5bd9ea3f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:35.039320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-203327f3-63fe-4a78-b443-dbbb5bd9ea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:35.054902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 693/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:35.137253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536903-9d69-4320-b5f3-4b2bb4327879 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:35.164687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39536903-9d69-4320-b5f3-4b2bb4327879 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:35.174044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:35.175161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:35.175637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:35.176884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:35.193541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:35.195348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64eecf-35c5-4a3f-ac80-5ff709f63002 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:35.210891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 695/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:37.582766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520523-3c8a-4a97-9fad-80e1a069e1df None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:37.583461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520523-3c8a-4a97-9fad-80e1a069e1df None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:37.583461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17520523-3c8a-4a97-9fad-80e1a069e1df None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:37.585782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 694/1389] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:39:37.593157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d703824-ec23-46dc-bca2-6aece732acb4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:37.594065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d703824-ec23-46dc-bca2-6aece732acb4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:37.594065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d703824-ec23-46dc-bca2-6aece732acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:37.618158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7d703824-ec23-46dc-bca2-6aece732acb4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:37.619779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7d703824-ec23-46dc-bca2-6aece732acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:37.629825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 696/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:37.683633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520523-3c8a-4a97-9fad-80e1a069e1df None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:37.701655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17520523-3c8a-4a97-9fad-80e1a069e1df None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:37.707902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:37.708661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:37.709318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:37.710388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:37.721289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:37.723312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273fae-96f8-40aa-942b-3b39b0291004 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:37.738744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 695/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:39.944128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a84a-2684-4b16-8b69-e9fc59781b20 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:39.945044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a84a-2684-4b16-8b69-e9fc59781b20 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:39.945044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0a84a-2684-4b16-8b69-e9fc59781b20 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:39.946909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 697/1392] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:39.955738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e5e-c40f-436d-bd5b-428066164e6b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:39.956268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e5e-c40f-436d-bd5b-428066164e6b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:39.956380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e5e-c40f-436d-bd5b-428066164e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:39.978486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c70f1e5e-c40f-436d-bd5b-428066164e6b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:39.979847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c70f1e5e-c40f-436d-bd5b-428066164e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:39.989558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 696/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:40.042051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a84a-2684-4b16-8b69-e9fc59781b20 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:40.059007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0a84a-2684-4b16-8b69-e9fc59781b20 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:40.067201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:40.068566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:40.069027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:40.069634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:40.082995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:40.086533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6a0d-5e71-4d99-8e06-76ca79241d25 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:40.107538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 698/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:42.630046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4fd4-313a-4b64-92f9-99a92d75a014 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:42.630674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4fd4-313a-4b64-92f9-99a92d75a014 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:42.630674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd4fd4-313a-4b64-92f9-99a92d75a014 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:42.632458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 697/1395] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:42.638544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c305-fbc9-4849-9e55-2f08f610fa09 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:42.639117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c305-fbc9-4849-9e55-2f08f610fa09 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:42.639224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c305-fbc9-4849-9e55-2f08f610fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:42.645462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=52 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:42.658718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-df66c305-fbc9-4849-9e55-2f08f610fa09 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:42.659919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-df66c305-fbc9-4849-9e55-2f08f610fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:42.670429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 699/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:42.719552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4fd4-313a-4b64-92f9-99a92d75a014 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:42.735987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd4fd4-313a-4b64-92f9-99a92d75a014 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:42.743230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:42.744045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:42.744577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:42.744965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:42.761546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:42.764893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb6302-edcf-4693-89b6-1d99023d0310 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:42.785188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 698/1397] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:43.399037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c1ce-4e35-4555-97b3-d2e040a6c104 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:43.399308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c1ce-4e35-4555-97b3-d2e040a6c104 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:43.399612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03c1ce-4e35-4555-97b3-d2e040a6c104 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:43.400999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 700/1398] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:43.408293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00bbb-cff6-4e04-b3f8-e9c27e057b6d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:43.408729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00bbb-cff6-4e04-b3f8-e9c27e057b6d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:43.409011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c00bbb-cff6-4e04-b3f8-e9c27e057b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:43.432403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-85c00bbb-cff6-4e04-b3f8-e9c27e057b6d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:43.433602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-85c00bbb-cff6-4e04-b3f8-e9c27e057b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:43.442826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 699/1399] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:43.504856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04eea-7f22-4276-8684-68af6cf7d6e0 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:43.505148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04eea-7f22-4276-8684-68af6cf7d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:43.505417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f04eea-7f22-4276-8684-68af6cf7d6e0 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:43.506904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 701/1400] 10.222.0.48 () {54 vars in 962 bytes} [Tue Jun 28 17:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:43.512678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d303c-a066-428d-a81e-ebe0ad503ba8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:43.512678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d303c-a066-428d-a81e-ebe0ad503ba8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:43.512919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d303c-a066-428d-a81e-ebe0ad503ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:43.572893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-258d303c-a066-428d-a81e-ebe0ad503ba8 None None] MFA Rules not processed for user `7d734accab24459a8a6848029c1f6315`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:43.574384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-258d303c-a066-428d-a81e-ebe0ad503ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:43.612054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:43.660915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 700/1401] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Jun 28 17:39:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:43.671500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f04eea-7f22-4276-8684-68af6cf7d6e0 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:43.684618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f04eea-7f22-4276-8684-68af6cf7d6e0 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:43.688248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:43.688908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:43.689183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:43.689453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:43.702413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:43.704033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf14d31-1e55-40dd-afb3-9782bcab443e service glance] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:43.715074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 702/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:44.645792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340caa-534f-49f0-9134-7058862f6428 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:44.646323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340caa-534f-49f0-9134-7058862f6428 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:44.646861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57340caa-534f-49f0-9134-7058862f6428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:44.724219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-57340caa-534f-49f0-9134-7058862f6428 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:44.726186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-57340caa-534f-49f0-9134-7058862f6428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:44.822960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 701/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:39:44.871145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc054d-52d3-447e-aafd-c1f9999b0720 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:44.871838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc054d-52d3-447e-aafd-c1f9999b0720 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:44.871838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc054d-52d3-447e-aafd-c1f9999b0720 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:44.873047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 703/1404] 10.222.0.48 () {54 vars in 942 bytes} [Tue Jun 28 17:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:44.879734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676b573-16a7-428f-b329-cd891a070da3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:44.880042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676b573-16a7-428f-b329-cd891a070da3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:44.880301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676b573-16a7-428f-b329-cd891a070da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:44.936876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b676b573-16a7-428f-b329-cd891a070da3 None None] MFA Rules not processed for user `dc6c5d2d92294b1396bd6ca40db346bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:44.937703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b676b573-16a7-428f-b329-cd891a070da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:45.045517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 702/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Tue Jun 28 17:39:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:45.055971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc054d-52d3-447e-aafd-c1f9999b0720 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:45.072280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc054d-52d3-447e-aafd-c1f9999b0720 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:45.078404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:45.079082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:45.079361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:45.079879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:45.092969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:45.094726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3afef-ce15-42ee-80fd-6411edf100b0 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:45.105336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 704/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:39:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:39:45.136360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf19ce-160b-4a6b-bb90-8d5e63f3ca87 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:45.136910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf19ce-160b-4a6b-bb90-8d5e63f3ca87 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:45.137426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf19ce-160b-4a6b-bb90-8d5e63f3ca87 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:45.140555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 703/1407] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:39:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:39:45.147158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b563-c412-41c5-8195-9dfe82b493c8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:45.147475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b563-c412-41c5-8195-9dfe82b493c8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:45.147776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058b563-c412-41c5-8195-9dfe82b493c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:45.167081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2058b563-c412-41c5-8195-9dfe82b493c8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:39:45.168310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2058b563-c412-41c5-8195-9dfe82b493c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:39:45.176663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 705/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:39:45.237726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf19ce-160b-4a6b-bb90-8d5e63f3ca87 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:39:45.260191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf19ce-160b-4a6b-bb90-8d5e63f3ca87 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:39:45.266282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:39:45.266950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:39:45.267236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:39:45.267530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:39:45.278146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:39:45.279818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646eb0-ec47-4a05-8735-b5a6f251d543 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:39:45.286354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:39:45.296308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 704/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:39:55.161767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=17 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:07.283654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e134a-eba0-4d3e-b4d4-5a0f3bd7c96f None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:07.284359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e134a-eba0-4d3e-b4d4-5a0f3bd7c96f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:07.284359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e134a-eba0-4d3e-b4d4-5a0f3bd7c96f None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:07.285575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 706/1410] 10.222.0.48 () {54 vars in 918 bytes} [Tue Jun 28 17:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:07.291126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389d4a-2860-4ddf-97b6-dee64c1cee1e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:07.291601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389d4a-2860-4ddf-97b6-dee64c1cee1e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:07.291699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e389d4a-2860-4ddf-97b6-dee64c1cee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:07.310747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0e389d4a-2860-4ddf-97b6-dee64c1cee1e None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:07.311949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0e389d4a-2860-4ddf-97b6-dee64c1cee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:07.320775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 705/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Jun 28 17:40:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:07.335643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca2be-69ad-4885-ac63-697518de79ec None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:07.335956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca2be-69ad-4885-ac63-697518de79ec None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:07.336258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adca2be-69ad-4885-ac63-697518de79ec None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:07.337612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 707/1412] 10.222.0.48 () {54 vars in 918 bytes} [Tue Jun 28 17:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:07.342720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db502-3665-470a-bb38-d0eadf78e020 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:07.343028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db502-3665-470a-bb38-d0eadf78e020 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:07.343309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67db502-3665-470a-bb38-d0eadf78e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:07.361912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c67db502-3665-470a-bb38-d0eadf78e020 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:07.363177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c67db502-3665-470a-bb38-d0eadf78e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:07.374594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 706/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Jun 28 17:40:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:09.913150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611abc-d046-4ef2-872e-b285951fcc16 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:09.913757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611abc-d046-4ef2-872e-b285951fcc16 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:09.913757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611abc-d046-4ef2-872e-b285951fcc16 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:09.915099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:40:09.920669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9d36-fa91-4614-a839-5f0bcdffb202 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:09.921123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9d36-fa91-4614-a839-5f0bcdffb202 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:09.921246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c9d36-fa91-4614-a839-5f0bcdffb202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:09.940528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b70c9d36-fa91-4614-a839-5f0bcdffb202 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:09.941738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b70c9d36-fa91-4614-a839-5f0bcdffb202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:09.949867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:09.994269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611abc-d046-4ef2-872e-b285951fcc16 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:10.011150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611abc-d046-4ef2-872e-b285951fcc16 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:10.016835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:10.017497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:10.017781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:10.018075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:10.027856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:10.029382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad8983-9241-48c7-8a10-b5b654fa8ad4 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:10.039832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 709/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:10.978175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a601c-cf67-45e7-95fa-9543d9da2bfe None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:10.978774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a601c-cf67-45e7-95fa-9543d9da2bfe None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:10.978774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a601c-cf67-45e7-95fa-9543d9da2bfe None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:10.980100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:10.985590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67f79-f6d8-4f07-af45-de8194676836 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:10.986043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67f79-f6d8-4f07-af45-de8194676836 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:10.986188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67f79-f6d8-4f07-af45-de8194676836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:11.007168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9bc67f79-f6d8-4f07-af45-de8194676836 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:11.008390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9bc67f79-f6d8-4f07-af45-de8194676836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:11.017360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:11.169360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a601c-cf67-45e7-95fa-9543d9da2bfe None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:11.187088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a601c-cf67-45e7-95fa-9543d9da2bfe None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:11.192753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:11.193400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:11.193779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:11.194079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:11.203164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:11.204773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a401d-afd0-44ad-abd3-075879e64861 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:11.215505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 709/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:12.132626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786290c-a47e-41e8-8fab-ea61e9183c9c None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:12.133216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786290c-a47e-41e8-8fab-ea61e9183c9c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:12.133216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786290c-a47e-41e8-8fab-ea61e9183c9c None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:12.134504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:12.139772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2271-7d48-490f-9d62-09dd5106451c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:12.140207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2271-7d48-490f-9d62-09dd5106451c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:12.140307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea2271-7d48-490f-9d62-09dd5106451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:12.159193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-75ea2271-7d48-490f-9d62-09dd5106451c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:12.160401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-75ea2271-7d48-490f-9d62-09dd5106451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:12.168983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:12.331168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786290c-a47e-41e8-8fab-ea61e9183c9c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:12.346444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786290c-a47e-41e8-8fab-ea61e9183c9c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:12.352381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:12.353024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:12.353301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:12.353627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:12.362836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:12.364414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee39371-d092-48ef-a25d-3c110245dcba service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:12.374730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 712/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:13.255745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4a4a-8b2b-43fe-a151-36e935babb4a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:13.256454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4a4a-8b2b-43fe-a151-36e935babb4a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:13.256454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c4a4a-8b2b-43fe-a151-36e935babb4a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:13.257694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:13.263323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fa97-110e-4064-9f1e-572f9f7138ec None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:13.263827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fa97-110e-4064-9f1e-572f9f7138ec None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:13.263941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6fa97-110e-4064-9f1e-572f9f7138ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:13.282744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ced6fa97-110e-4064-9f1e-572f9f7138ec None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:13.283964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ced6fa97-110e-4064-9f1e-572f9f7138ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:13.292548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:13.446182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c4a4a-8b2b-43fe-a151-36e935babb4a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:13.461634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c4a4a-8b2b-43fe-a151-36e935babb4a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:13.467589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:13.468238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:13.468506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:13.468783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:13.478154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:13.479757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1044c9-4439-4524-bf8d-ee583b45f0eb service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:13.489759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 712/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:14.402954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d3fd-188d-4624-8811-8db1e5afafcd None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:14.403568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d3fd-188d-4624-8811-8db1e5afafcd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:14.403568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d3fd-188d-4624-8811-8db1e5afafcd None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:14.404858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:14.410456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0474-aaf4-4200-82e2-e7b244299236 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:14.410993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0474-aaf4-4200-82e2-e7b244299236 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:14.411121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade0474-aaf4-4200-82e2-e7b244299236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:14.430852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0ade0474-aaf4-4200-82e2-e7b244299236 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:14.432073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0ade0474-aaf4-4200-82e2-e7b244299236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:14.440852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:14.591422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d3fd-188d-4624-8811-8db1e5afafcd None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:14.608298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d3fd-188d-4624-8811-8db1e5afafcd None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:14.613926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:14.614597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:14.614859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:14.615130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:14.624213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:14.625798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdc53f-073c-49bb-b08f-cc71070cc5d7 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:14.635541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 715/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:15.457281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc41b-9899-4dad-adc0-e6c1968aa068 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:15.457903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc41b-9899-4dad-adc0-e6c1968aa068 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:15.457903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dc41b-9899-4dad-adc0-e6c1968aa068 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:15.459349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:15.465258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f978-5710-460f-815b-c753726d25b0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:15.465745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f978-5710-460f-815b-c753726d25b0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:15.465745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f978-5710-460f-815b-c753726d25b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:15.485349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d1e4f978-5710-460f-815b-c753726d25b0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:15.486622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d1e4f978-5710-460f-815b-c753726d25b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:15.496007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:15.654146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc41b-9899-4dad-adc0-e6c1968aa068 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:15.670266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dc41b-9899-4dad-adc0-e6c1968aa068 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:15.676772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:15.677460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:15.677701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:15.678180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:15.687550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:15.689180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99046211-3c29-4ddd-aff6-1c5d02be12ec service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:15.700123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 715/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:16.534875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472292d6-1f31-49c7-8882-dfdd92767ee9 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:16.535474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472292d6-1f31-49c7-8882-dfdd92767ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:16.535474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472292d6-1f31-49c7-8882-dfdd92767ee9 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:16.536841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:40:16.543360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4378d-330e-4199-9c71-aa0a75b61d97 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:16.543896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4378d-330e-4199-9c71-aa0a75b61d97 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:16.543896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4378d-330e-4199-9c71-aa0a75b61d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:16.563987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-66e4378d-330e-4199-9c71-aa0a75b61d97 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:16.565197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-66e4378d-330e-4199-9c71-aa0a75b61d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:16.575217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:16.725918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472292d6-1f31-49c7-8882-dfdd92767ee9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:16.742268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472292d6-1f31-49c7-8882-dfdd92767ee9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:16.748150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:16.748790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:16.749068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:16.749339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:16.759533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:16.761651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d9514-f13f-458c-a2bf-eab0f38d92c5 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:16.774244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 718/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:17.595556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a369b-d759-4a0e-b5d4-5ba42738a35e None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:17.596143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a369b-d759-4a0e-b5d4-5ba42738a35e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:17.596143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a369b-d759-4a0e-b5d4-5ba42738a35e None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:17.597565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:17.603486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327325-2f99-4bc9-8aff-fb06f97d30c3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:17.603920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327325-2f99-4bc9-8aff-fb06f97d30c3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:17.604011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327325-2f99-4bc9-8aff-fb06f97d30c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:17.623995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5a327325-2f99-4bc9-8aff-fb06f97d30c3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:17.625221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5a327325-2f99-4bc9-8aff-fb06f97d30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:17.635601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:17.785643 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a369b-d759-4a0e-b5d4-5ba42738a35e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:17.800696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a369b-d759-4a0e-b5d4-5ba42738a35e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:17.807006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:17.807648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:17.807926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:17.808221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:17.816920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:17.818567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dca40-51ac-48ff-87e6-eb0c96ff8262 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:17.829494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 718/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:18.654507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07fe3-dede-4ec6-822e-bb894b71db3b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:18.655116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07fe3-dede-4ec6-822e-bb894b71db3b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:18.655116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07fe3-dede-4ec6-822e-bb894b71db3b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:18.656586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:18.662037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f63794-140d-430e-a95c-5d0e363ea29d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:18.662870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f63794-140d-430e-a95c-5d0e363ea29d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:18.663206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f63794-140d-430e-a95c-5d0e363ea29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:18.682631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-03f63794-140d-430e-a95c-5d0e363ea29d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:18.683837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-03f63794-140d-430e-a95c-5d0e363ea29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:18.692065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:18.845208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07fe3-dede-4ec6-822e-bb894b71db3b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:18.860527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07fe3-dede-4ec6-822e-bb894b71db3b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:18.867085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:18.867728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:18.868007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:18.868280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:18.877005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:18.878632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663d7a9-6e54-4140-9f54-57182ed199b2 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:18.890128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 721/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:20.825625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b6f1-4666-4cc0-9ad1-7fe206bad3ca None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:20.826310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b6f1-4666-4cc0-9ad1-7fe206bad3ca None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:20.826310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293b6f1-4666-4cc0-9ad1-7fe206bad3ca None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:20.827730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:20.834191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba937b95-39f6-446a-a8c3-3364ec35f3cc None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:20.834846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba937b95-39f6-446a-a8c3-3364ec35f3cc None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:20.835107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba937b95-39f6-446a-a8c3-3364ec35f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:20.854700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ba937b95-39f6-446a-a8c3-3364ec35f3cc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:20.855963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ba937b95-39f6-446a-a8c3-3364ec35f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:20.864537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:20.909611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293b6f1-4666-4cc0-9ad1-7fe206bad3ca None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:20.928014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293b6f1-4666-4cc0-9ad1-7fe206bad3ca None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:20.931918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:20.932570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:20.932850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:20.933124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:20.942905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:20.944666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1e8ce-2287-46fa-9897-af9f77014102 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:20.954345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 721/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:23.254737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04048529-731a-4e75-a051-b02ac26997b3 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:23.255335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04048529-731a-4e75-a051-b02ac26997b3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:23.255335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04048529-731a-4e75-a051-b02ac26997b3 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:23.256760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:23.263381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f88c0-041e-4141-b9a4-6016f7502073 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:23.263912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f88c0-041e-4141-b9a4-6016f7502073 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:23.264027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f88c0-041e-4141-b9a4-6016f7502073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:23.284169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-061f88c0-041e-4141-b9a4-6016f7502073 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:23.285396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-061f88c0-041e-4141-b9a4-6016f7502073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:23.303110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:23.342826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04048529-731a-4e75-a051-b02ac26997b3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:23.354472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04048529-731a-4e75-a051-b02ac26997b3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:23.358997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:23.359650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:23.359916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:23.360184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:23.370399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:23.371865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1b88a-2aba-41dd-a07e-c10687b1a647 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:23.382094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 724/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:25.761417 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e82d-3770-42ac-976c-557f7a8e4992 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:25.762166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e82d-3770-42ac-976c-557f7a8e4992 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:25.762166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365e82d-3770-42ac-976c-557f7a8e4992 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:25.763391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:25.768978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878e4a-7c29-4558-b3dd-4c9eea26155a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:25.769491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878e4a-7c29-4558-b3dd-4c9eea26155a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:25.769491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5878e4a-7c29-4558-b3dd-4c9eea26155a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:25.787912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d5878e4a-7c29-4558-b3dd-4c9eea26155a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:25.789113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d5878e4a-7c29-4558-b3dd-4c9eea26155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:25.797579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:25.837484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365e82d-3770-42ac-976c-557f7a8e4992 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:25.849287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365e82d-3770-42ac-976c-557f7a8e4992 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:25.853212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:25.853861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:25.854176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:25.854450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:25.864317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:25.865996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfce63-a86e-4d18-b6ac-67f408e7d050 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:25.876577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 724/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:40:28.078020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030fc0-6532-4880-bfcc-1c80b0ad51f7 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:28.078582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030fc0-6532-4880-bfcc-1c80b0ad51f7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:28.078582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62030fc0-6532-4880-bfcc-1c80b0ad51f7 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:28.079873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:28.085900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89605f3-0893-45da-b9f2-b7f608943271 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:28.086467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89605f3-0893-45da-b9f2-b7f608943271 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:28.086467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89605f3-0893-45da-b9f2-b7f608943271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:28.106148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a89605f3-0893-45da-b9f2-b7f608943271 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:28.107350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a89605f3-0893-45da-b9f2-b7f608943271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:28.117283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:28.156576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030fc0-6532-4880-bfcc-1c80b0ad51f7 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:28.169552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62030fc0-6532-4880-bfcc-1c80b0ad51f7 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:28.181341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:28.182175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:28.182566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:28.183236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:28.193780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:28.195806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647de834-7171-4c98-8681-97447c7f1d4c service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:28.205982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 727/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:30.375773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8de3-6205-4c36-bcdc-b3a7d6d998d1 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:30.376381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8de3-6205-4c36-bcdc-b3a7d6d998d1 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:30.376381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d8de3-6205-4c36-bcdc-b3a7d6d998d1 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:30.377708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:30.383625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621c19-451e-4e66-be6f-fcba4b3214e5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:30.384111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621c19-451e-4e66-be6f-fcba4b3214e5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:30.384210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621c19-451e-4e66-be6f-fcba4b3214e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:30.403748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f1621c19-451e-4e66-be6f-fcba4b3214e5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:30.404990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f1621c19-451e-4e66-be6f-fcba4b3214e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:30.414451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:30.453169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d8de3-6205-4c36-bcdc-b3a7d6d998d1 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:30.465255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d8de3-6205-4c36-bcdc-b3a7d6d998d1 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:30.469746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:30.470418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:30.470827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:30.470940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:30.481233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:30.482855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3c6f-e841-4402-ad4d-10dd13cd424c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:30.493344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 727/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:32.667850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77142-d4d8-47ff-8e41-10a65841177b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:32.668451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77142-d4d8-47ff-8e41-10a65841177b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:32.668451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77142-d4d8-47ff-8e41-10a65841177b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:32.669743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:32.675252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c065-f3b0-4ff7-bc67-8081f466c7db None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:32.675718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c065-f3b0-4ff7-bc67-8081f466c7db None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:32.675829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c065-f3b0-4ff7-bc67-8081f466c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:32.694820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2c19c065-f3b0-4ff7-bc67-8081f466c7db None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:32.696055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2c19c065-f3b0-4ff7-bc67-8081f466c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:32.704698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:32.742873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77142-d4d8-47ff-8e41-10a65841177b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:32.754727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77142-d4d8-47ff-8e41-10a65841177b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:32.758407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:32.759066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:32.759342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:32.759601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:32.769507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:32.770985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a134c08-c3bf-4046-aab3-abbae11cbc74 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:32.781961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 730/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:34.867764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700b60c-a170-4877-ab10-77f36ea2807b None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:34.868381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700b60c-a170-4877-ab10-77f36ea2807b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:34.868381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700b60c-a170-4877-ab10-77f36ea2807b None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:34.869803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:34.876003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ffd5-1ef9-4de8-84ac-056985138f46 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:34.876594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ffd5-1ef9-4de8-84ac-056985138f46 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:34.876594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ffd5-1ef9-4de8-84ac-056985138f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:34.899383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-69a3ffd5-1ef9-4de8-84ac-056985138f46 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:34.900634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-69a3ffd5-1ef9-4de8-84ac-056985138f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:34.909855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:34.950305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700b60c-a170-4877-ab10-77f36ea2807b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:34.962888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700b60c-a170-4877-ab10-77f36ea2807b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:34.966808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:34.967481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:34.967757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:34.968027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:34.978098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:34.979699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551e87-779b-4f24-9bdd-040a5655d5a8 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:34.989773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 730/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:37.086160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67dd2-6424-40ed-a5ba-2769bb2149eb None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:37.086721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67dd2-6424-40ed-a5ba-2769bb2149eb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:37.086721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae67dd2-6424-40ed-a5ba-2769bb2149eb None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:37.088098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:37.093920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30e8c-29f4-41e8-bdfb-5dcf1ecdaf93 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:37.094439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30e8c-29f4-41e8-bdfb-5dcf1ecdaf93 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:37.094618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30e8c-29f4-41e8-bdfb-5dcf1ecdaf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:37.101168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=79 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:37.114136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-43c30e8c-29f4-41e8-bdfb-5dcf1ecdaf93 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:37.115365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-43c30e8c-29f4-41e8-bdfb-5dcf1ecdaf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:37.123624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:37.161298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67dd2-6424-40ed-a5ba-2769bb2149eb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:37.167675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=73 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:37.180829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae67dd2-6424-40ed-a5ba-2769bb2149eb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:37.185355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:37.186060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:37.186348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:37.186630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:37.196671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:37.198151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc82693-f089-4e89-ac88-ab2baf6da9f1 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:37.208430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 733/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:39.274375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0be16-0076-4804-a137-286a503908f3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:39.275009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0be16-0076-4804-a137-286a503908f3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:39.275009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0be16-0076-4804-a137-286a503908f3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:39.276877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:39.282743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e019ec0-794e-40ca-a0f2-9e18b312b8d5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:39.283481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e019ec0-794e-40ca-a0f2-9e18b312b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:39.283481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e019ec0-794e-40ca-a0f2-9e18b312b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:39.302030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2e019ec0-794e-40ca-a0f2-9e18b312b8d5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:39.303707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2e019ec0-794e-40ca-a0f2-9e18b312b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:39.312039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:40:39.348900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0be16-0076-4804-a137-286a503908f3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:39.360157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0be16-0076-4804-a137-286a503908f3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:39.364012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:39.364645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:39.364927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:39.365182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:39.374818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:39.376270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af011598-8898-4769-80f6-2799d5523690 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:39.385840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 733/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:41.461033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6169a5-15a2-4b45-8cb2-a9fdcd213a23 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:41.461673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6169a5-15a2-4b45-8cb2-a9fdcd213a23 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:41.461673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6169a5-15a2-4b45-8cb2-a9fdcd213a23 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:41.463068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:40:41.469256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684c97-63fd-4196-b26a-fc392a22e6e7 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:41.469731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684c97-63fd-4196-b26a-fc392a22e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:41.470112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12684c97-63fd-4196-b26a-fc392a22e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:41.496607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-12684c97-63fd-4196-b26a-fc392a22e6e7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:40:41.497860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-12684c97-63fd-4196-b26a-fc392a22e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:40:41.508302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:40:41.545278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6169a5-15a2-4b45-8cb2-a9fdcd213a23 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:40:41.558098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6169a5-15a2-4b45-8cb2-a9fdcd213a23 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:40:41.561775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:40:41.562488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:40:41.562792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:40:41.563086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:40:41.573421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:40:41.574902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d0213-bd6d-470d-a639-cf21caf64c32 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:40:41.584609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 736/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:40:51.488257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=11 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:40:51.580403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=14 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:41:01.667404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a78842-48a4-463e-acee-2f8035cb4822 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:01.668014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a78842-48a4-463e-acee-2f8035cb4822 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:01.668014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a78842-48a4-463e-acee-2f8035cb4822 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:01.669332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 735/1471] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:41:01.675220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895782-4280-45c1-8299-8e4e302462fc None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:01.675697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895782-4280-45c1-8299-8e4e302462fc None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:01.675828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5895782-4280-45c1-8299-8e4e302462fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:01.695600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c5895782-4280-45c1-8299-8e4e302462fc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:01.696833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c5895782-4280-45c1-8299-8e4e302462fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:01.705803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 737/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:01.756118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997ace-156a-461b-8425-bfd367044620 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:01.756584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997ace-156a-461b-8425-bfd367044620 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:01.758008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93997ace-156a-461b-8425-bfd367044620 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:01.760050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 736/1473] 10.222.0.48 () {54 vars in 962 bytes} [Tue Jun 28 17:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:01.767179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6b50-7413-4cb2-8c79-a8350822b9a5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:01.767486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6b50-7413-4cb2-8c79-a8350822b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:01.767767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6b50-7413-4cb2-8c79-a8350822b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:01.787281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-cb5f6b50-7413-4cb2-8c79-a8350822b9a5 None None] MFA Rules not processed for user `7d734accab24459a8a6848029c1f6315`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:01.789053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cb5f6b50-7413-4cb2-8c79-a8350822b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:01.796188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 738/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Jun 28 17:41:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:01.804429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997ace-156a-461b-8425-bfd367044620 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:01.816126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93997ace-156a-461b-8425-bfd367044620 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:01.820018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:01.820883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:01.821167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:01.821446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:01.831311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:01.832765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f9e83-f79f-4006-98cf-bd652c09a61e service glance] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:01.843484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 737/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:03.987659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473f7d4-03d4-4cdc-b009-774a9bb21993 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:03.988570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473f7d4-03d4-4cdc-b009-774a9bb21993 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:03.988570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473f7d4-03d4-4cdc-b009-774a9bb21993 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:03.990837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 739/1476] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:03.996945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fce3b-71f3-42c4-85bc-3b1bd4c17848 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:03.997452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fce3b-71f3-42c4-85bc-3b1bd4c17848 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:03.997554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fce3b-71f3-42c4-85bc-3b1bd4c17848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:04.016005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-388fce3b-71f3-42c4-85bc-3b1bd4c17848 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:04.017216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-388fce3b-71f3-42c4-85bc-3b1bd4c17848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:04.025681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 738/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:04.050072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473f7d4-03d4-4cdc-b009-774a9bb21993 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:04.065776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473f7d4-03d4-4cdc-b009-774a9bb21993 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:04.071240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:04.071920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:04.072197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:04.072468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:04.073213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:04.075038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:41:04.075038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:41:04.075038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:41:04.076202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c24efc-4d16-4fff-8941-7a831053a196 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:04.097076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 740/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Jun 28 17:41:04 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:41:06.150698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee4e9-036f-4fef-a4ba-bf651149a605 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:06.151287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee4e9-036f-4fef-a4ba-bf651149a605 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:06.151287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ee4e9-036f-4fef-a4ba-bf651149a605 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:06.152553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 739/1479] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:06.158035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956f98-21a9-44d7-9e7c-47775abeb1a7 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:06.158528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956f98-21a9-44d7-9e7c-47775abeb1a7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:06.158623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e956f98-21a9-44d7-9e7c-47775abeb1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:06.178719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8e956f98-21a9-44d7-9e7c-47775abeb1a7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:06.179991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8e956f98-21a9-44d7-9e7c-47775abeb1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:06.189452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 741/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:06.233844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ee4e9-036f-4fef-a4ba-bf651149a605 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:06.250523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ee4e9-036f-4fef-a4ba-bf651149a605 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:06.257088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:06.257847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:06.258186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:06.258515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:06.268450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:06.270185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79956dac-07cc-46c8-a24d-a78223fed667 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:06.280967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 740/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:08.589079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801da1-5000-49a9-b646-c9e71d87bf05 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:08.589673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801da1-5000-49a9-b646-c9e71d87bf05 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:08.589787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2801da1-5000-49a9-b646-c9e71d87bf05 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:08.591184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 742/1482] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:08.597498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09c4b-9f9b-4edc-8699-8084a720ad81 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:08.598050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09c4b-9f9b-4edc-8699-8084a720ad81 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:08.598276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c09c4b-9f9b-4edc-8699-8084a720ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:08.616803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-69c09c4b-9f9b-4edc-8699-8084a720ad81 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:08.618050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-69c09c4b-9f9b-4edc-8699-8084a720ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:08.626581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 741/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:08.663283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2801da1-5000-49a9-b646-c9e71d87bf05 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:08.686042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2801da1-5000-49a9-b646-c9e71d87bf05 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:08.689643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:08.690341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:08.690604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:08.690885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:08.701370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:08.704963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175242f6-cc7d-4a76-a1ba-1525e1edb860 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:08.713925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 743/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:10.859851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cfe0b-7e25-4795-9193-be74fb60635a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:10.860454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cfe0b-7e25-4795-9193-be74fb60635a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:10.860454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cfe0b-7e25-4795-9193-be74fb60635a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:10.861800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 742/1485] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:10.867401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147cf68-4fca-4806-a222-f91a0633ac3f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:10.867877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147cf68-4fca-4806-a222-f91a0633ac3f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:10.867981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147cf68-4fca-4806-a222-f91a0633ac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:10.887742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0147cf68-4fca-4806-a222-f91a0633ac3f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:10.888941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0147cf68-4fca-4806-a222-f91a0633ac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:10.898457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 744/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:10.938565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cfe0b-7e25-4795-9193-be74fb60635a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:10.950177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cfe0b-7e25-4795-9193-be74fb60635a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:10.953657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:10.954342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:10.954623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:10.954902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:10.965020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:10.966506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddfc23-0362-46d9-b1e2-61e3f3e9706b service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:10.976941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 743/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:13.195085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2df18-f69a-49bc-a539-14a8804bb92b None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:13.195660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2df18-f69a-49bc-a539-14a8804bb92b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:13.195660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2df18-f69a-49bc-a539-14a8804bb92b None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:13.196994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 745/1488] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:13.202582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e952b4-cdec-40fd-9440-da15a26c6d8b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:13.203065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e952b4-cdec-40fd-9440-da15a26c6d8b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:13.203201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e952b4-cdec-40fd-9440-da15a26c6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:13.222113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a5e952b4-cdec-40fd-9440-da15a26c6d8b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:13.223356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a5e952b4-cdec-40fd-9440-da15a26c6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:13.232822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 744/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:13.273452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2df18-f69a-49bc-a539-14a8804bb92b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:13.285577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2df18-f69a-49bc-a539-14a8804bb92b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:13.289960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:13.290640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:13.290945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:13.291218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:13.300845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:13.302701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571512bf-6ce6-4ec0-9c73-50bef8796e70 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:13.314709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 746/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:15.605204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939a55-3cea-4742-97f3-635b52173f30 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:15.605781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939a55-3cea-4742-97f3-635b52173f30 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:15.605781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939a55-3cea-4742-97f3-635b52173f30 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:15.607187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 745/1491] 10.222.0.48 () {54 vars in 926 bytes} [Tue Jun 28 17:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:41:15.613649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3de0-e88e-4d96-b113-6eea9181cafd None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:15.614142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3de0-e88e-4d96-b113-6eea9181cafd None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:15.614259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3de0-e88e-4d96-b113-6eea9181cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:15.640856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ef2f3de0-e88e-4d96-b113-6eea9181cafd None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:41:15.642104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ef2f3de0-e88e-4d96-b113-6eea9181cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:41:15.651650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 747/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Jun 28 17:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:41:15.694967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939a55-3cea-4742-97f3-635b52173f30 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:41:15.711963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939a55-3cea-4742-97f3-635b52173f30 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:41:15.717218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:41:15.717868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:41:15.718176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:41:15.718453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:41:15.730662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:41:15.732170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d78b-162e-49bd-a4ad-4397c44fe84b service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:41:15.742497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 746/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:41:25.634986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=33 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:41:25.737719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=33 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:42:40.956233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:40.956942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:40.956942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:40.976101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:42:40.977421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:40.989268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 748/1494] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:42:40.999661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:40.999661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.000302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.019440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:42:41.020663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:41.029905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 747/1495] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:42:41.034910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.044712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520782e-d9b1-40c3-b525-86b12c547eee None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.049351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.050053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.050339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.050613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.051339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:42:41.051645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.052663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.052663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:42:41.052663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:42:41.053926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.068778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 749/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:42:41.077626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.087903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b2f2-89bf-4edd-85e9-dd63c8272f05 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.093576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.094294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.094579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.094852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.095553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.097403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.097403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:42:41.097403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:42:41.098680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.141867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 748/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:42:41 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:42:41.146512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.160614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fbd17-455a-4d3f-9d30-a2627c9536c7 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.234588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.235211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.235498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.235781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.236998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.238095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.238095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:42:41.238095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:42:41.239321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.263351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 750/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:42:41 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:42:41.268069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.279625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255272-3b10-461a-8853-f8211f45e706 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.285411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.286158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.286441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.286715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.287459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.288509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.288509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:42:41.288509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:42:41.289738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.304705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 749/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:42:41.309139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.319684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa291f-ebb0-488e-ab62-08d410565433 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.324809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.325497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.325768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.326066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.326807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.327820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.327820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:42:41.327820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:42:41.328703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f290e-982f-4e18-b789-866e5a61b833 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.343932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 751/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:42:41.348442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.360823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835fcc7-e3e1-4b52-b5b1-0ecfa5210f68 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.367897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.368836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.369272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.369694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] PATH_INFO: `/v3/projects/a2ab27f5c2554cd4a4bb9ce117d5df81/users/dc87bcaf91ce47798c6604996aba731e/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.392242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ab27f5c2554cd4a4bb9ce117d5df81, user_id=dc87bcaf91ce47798c6604996aba731e, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.393338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.393338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:42:41.393338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:42:41.395335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef05f-6d5a-4f9c-843d-f2ae7b00c325 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.410988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 750/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:42:41 2022] PUT /identity/v3/projects/a2ab27f5c2554cd4a4bb9ce117d5df81/users/dc87bcaf91ce47798c6604996aba731e/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:42:41.422512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55598-6549-4e3d-85e4-ceab4236c616 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.422797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55598-6549-4e3d-85e4-ceab4236c616 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.423080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a55598-6549-4e3d-85e4-ceab4236c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.452127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f8a55598-6549-4e3d-85e4-ceab4236c616 None None] MFA Rules not processed for user `dc87bcaf91ce47798c6604996aba731e`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:42:41.453369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f8a55598-6549-4e3d-85e4-ceab4236c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:41.527783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 752/1502] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:42:41.543160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292a01-95be-42ac-b40a-d56dd2b9bdc1 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.543449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292a01-95be-42ac-b40a-d56dd2b9bdc1 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.543731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92292a01-95be-42ac-b40a-d56dd2b9bdc1 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.545143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 751/1503] 10.222.0.48 () {54 vars in 963 bytes} [Tue Jun 28 17:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:42:41.550221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad54e-dad5-4dc8-8dc8-33d04dfa6d79 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.550507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad54e-dad5-4dc8-8dc8-33d04dfa6d79 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.550788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad54e-dad5-4dc8-8dc8-33d04dfa6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.570464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-32fad54e-dad5-4dc8-8dc8-33d04dfa6d79 None None] MFA Rules not processed for user `5fabfc6086e244db994a4bbbbbdfc5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:42:41.572034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-32fad54e-dad5-4dc8-8dc8-33d04dfa6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:41.621803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:42:41.632122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 753/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Jun 28 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:42:41.640906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92292a01-95be-42ac-b40a-d56dd2b9bdc1 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.653284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92292a01-95be-42ac-b40a-d56dd2b9bdc1 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.657065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.657762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.658114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.658457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.668786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.670408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.680677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 752/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:42:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:42:41.724480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debca1-45a8-4bb4-97f4-f40ac9492348 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.724764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debca1-45a8-4bb4-97f4-f40ac9492348 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.725039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9debca1-45a8-4bb4-97f4-f40ac9492348 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.726386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 754/1506] 10.222.0.48 () {52 vars in 829 bytes} [Tue Jun 28 17:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:42:41.730279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:41.797571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444159f-2a8e-41fb-9dd3-18346a5c29ea service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:41.803576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:41.804548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.804893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.805195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] PATH_INFO: `/v3/users/dc87bcaf91ce47798c6604996aba731e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.806494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc87bcaf91ce47798c6604996aba731e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:41.807527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:41.807527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:42:41.807527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:42:41.808749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:41.882051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc87bcaf91ce47798c6604996aba731e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:41.882959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc87bcaf91ce47798c6604996aba731e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:41.883908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc87bcaf91ce47798c6604996aba731e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:41.897377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc87bcaf91ce47798c6604996aba731e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:41.908965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc87bcaf91ce47798c6604996aba731e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:41.926017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:42:41.935618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 753/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:42:41 2022] DELETE /identity/v3/users/dc87bcaf91ce47798c6604996aba731e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:42:41.940312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:41.940612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:41.940884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:41.959007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:42:41.960223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:42.025955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 755/1508] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:42:42.036003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:42.037969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:42.100132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55036712-db65-4c7d-9df8-90052d76efba admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:42.104381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:42.105035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:42.105317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:42.105595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:42.116693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:42.118311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edf683-58b3-45ef-b82a-4b241d0f4e4c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:42.128046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 754/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:42:42.464973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:42:42.466758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:42:42.482090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e867-bdad-4269-8ce8-874f57609c9a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:42:42.491858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:42:42.493037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:42:42.493374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:42:42.493701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] PATH_INFO: `/v3/projects/a2ab27f5c2554cd4a4bb9ce117d5df81` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:42:42.495304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ab27f5c2554cd4a4bb9ce117d5df81)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:42:42.496436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:42:42.496436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:42:42.496436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:42:42.497796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:42:42.563129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ab27f5c2554cd4a4bb9ce117d5df81', 'request_id': 'req-5a778053-80d6-4cb9-a54b-2aa4c4b46210'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:42.569607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ab27f5c2554cd4a4bb9ce117d5df81', 'request_id': 'req-5a778053-80d6-4cb9-a54b-2aa4c4b46210'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:42.584761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ab27f5c2554cd4a4bb9ce117d5df81', 'request_id': 'req-5a778053-80d6-4cb9-a54b-2aa4c4b46210'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:42.600945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] The token cache is being invalidate because project a2ab27f5c2554cd4a4bb9ce117d5df81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:42:42.601236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:42.601926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5a778053-80d6-4cb9-a54b-2aa4c4b46210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:42:42.603630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 756/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:42:42 2022] DELETE /identity/v3/projects/a2ab27f5c2554cd4a4bb9ce117d5df81 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:42:52.123775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:42:52.597735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:28.853875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:28.854742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:28.854742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:28.855961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:28.862244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd4b-bd26-4fd9-a873-b80a7da5af50 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:28.862941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd4b-bd26-4fd9-a873-b80a7da5af50 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:28.863318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6fd4b-bd26-4fd9-a873-b80a7da5af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:28.886962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-33f6fd4b-bd26-4fd9-a873-b80a7da5af50 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:28.888200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-33f6fd4b-bd26-4fd9-a873-b80a7da5af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:28.960514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:29.122678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:29.124657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:29.201236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6066-4007-435f-bd7a-749675645333 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:29.207828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:29.208492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:29.208798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:29.209070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:29.219210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:29.220837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7b9f4-f54e-4d3f-be17-da91215fac6b service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:29.231874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 756/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:30.061862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7142e02-c85b-446a-a4f2-67fad393dda3 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:30.062682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7142e02-c85b-446a-a4f2-67fad393dda3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:30.062837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7142e02-c85b-446a-a4f2-67fad393dda3 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:30.065392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:44:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:30.071009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d248a-2158-4942-99ed-335c12cf7a41 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:30.071494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d248a-2158-4942-99ed-335c12cf7a41 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:30.071600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d248a-2158-4942-99ed-335c12cf7a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:30.090506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7c0d248a-2158-4942-99ed-335c12cf7a41 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:30.091755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7c0d248a-2158-4942-99ed-335c12cf7a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:30.101047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:30.256940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7142e02-c85b-446a-a4f2-67fad393dda3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:30.273233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7142e02-c85b-446a-a4f2-67fad393dda3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:30.279628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:30.280287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:30.280595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:30.280838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:30.289717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:30.291379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d4d48-23ca-485e-b134-02b450025b03 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:30.302285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 759/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:30.397792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3fa7f-267b-4c57-adc0-941aed26df06 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:30.398168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3fa7f-267b-4c57-adc0-941aed26df06 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:30.398413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3fa7f-267b-4c57-adc0-941aed26df06 None None] PATH_INFO: `/v3` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:30.399749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 758/1517] 10.222.0.49 () {54 vars in 925 bytes} [Tue Jun 28 17:44:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:44:30.422659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf653-b85a-485a-8c0f-4b2003efd019 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:30.422941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf653-b85a-485a-8c0f-4b2003efd019 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:30.423220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf653-b85a-485a-8c0f-4b2003efd019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:30.442823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-605bf653-b85a-485a-8c0f-4b2003efd019 None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:30.444018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-605bf653-b85a-485a-8c0f-4b2003efd019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:30.509758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 760/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jun 28 17:44:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:39.640056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6b3a5-28b1-419f-b5c5-c2e155c665a3 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:39.640595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6b3a5-28b1-419f-b5c5-c2e155c665a3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:39.640595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6b3a5-28b1-419f-b5c5-c2e155c665a3 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:39.641994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 759/1519] 10.222.0.48 () {54 vars in 960 bytes} [Tue Jun 28 17:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:39.647841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b81b1-1b29-4058-8ded-69d5dda33b7e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:39.648404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b81b1-1b29-4058-8ded-69d5dda33b7e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:39.648404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b81b1-1b29-4058-8ded-69d5dda33b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:39.669520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-286b81b1-1b29-4058-8ded-69d5dda33b7e None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:39.670854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-286b81b1-1b29-4058-8ded-69d5dda33b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:39.680883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 761/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Jun 28 17:44:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:39.689761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6b3a5-28b1-419f-b5c5-c2e155c665a3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:39.705369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6b3a5-28b1-419f-b5c5-c2e155c665a3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:39.711114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:39.711786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:39.712133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:39.712360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:39.723524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:39.725214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5807add-9ae5-4d05-8f35-05c7690a9eb4 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:39.736555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 760/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:41.546905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e270-3b74-48c2-a4d5-6ed41682bd78 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:41.547469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e270-3b74-48c2-a4d5-6ed41682bd78 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:41.547469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2e270-3b74-48c2-a4d5-6ed41682bd78 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:41.548962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:41.554071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da1dd-0042-47fd-a0f7-159826628a2b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:41.554620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da1dd-0042-47fd-a0f7-159826628a2b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:41.554620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87da1dd-0042-47fd-a0f7-159826628a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:41.574316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a87da1dd-0042-47fd-a0f7-159826628a2b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:41.575521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a87da1dd-0042-47fd-a0f7-159826628a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:41.584853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:41.744385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2e270-3b74-48c2-a4d5-6ed41682bd78 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:41.760550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2e270-3b74-48c2-a4d5-6ed41682bd78 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:41.767185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:41.767844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:41.768248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:41.768531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:41.777837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:41.779845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31243e-0fef-48ba-9a81-c0532d4f8a97 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:41.790269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 763/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:42.610013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65811e-0769-4a8c-ba7b-af6528b5f404 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:42.610607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65811e-0769-4a8c-ba7b-af6528b5f404 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:42.610607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65811e-0769-4a8c-ba7b-af6528b5f404 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:42.611957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 28 17:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:42.617317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b150a-7487-426f-b34a-ca90b1f77e38 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:42.617744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b150a-7487-426f-b34a-ca90b1f77e38 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:42.617886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b150a-7487-426f-b34a-ca90b1f77e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:42.637869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b67b150a-7487-426f-b34a-ca90b1f77e38 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:42.639169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b67b150a-7487-426f-b34a-ca90b1f77e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:42.647262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 28 17:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:42.800589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65811e-0769-4a8c-ba7b-af6528b5f404 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:42.816776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65811e-0769-4a8c-ba7b-af6528b5f404 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:42.822744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:42.823401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:42.823682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:42.823958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:42.833660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:42.835371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664abcca-5daa-494f-b962-501cb12df9f8 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:42.846050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 763/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:46.624863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:46.625489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:46.625489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:46.626872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:46.632879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c221-7565-4474-ae1a-2d728beeecba None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:46.633486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c221-7565-4474-ae1a-2d728beeecba None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:46.633652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5c221-7565-4474-ae1a-2d728beeecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:46.655150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e8c5c221-7565-4474-ae1a-2d728beeecba None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:46.656376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e8c5c221-7565-4474-ae1a-2d728beeecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:46.665170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:46.703032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:46.704896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:46.761933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ab203-bb89-4e12-9e97-c10cf9999e42 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:46.765840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:46.766531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:46.766830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:46.767086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:46.777406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:46.778933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d807d-2b7d-44d9-8d43-991e0183ae19 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:46.784487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:46.789908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 766/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:48.848146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ab-7045-49d3-8e4c-86096d7dfc97 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:48.848739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ab-7045-49d3-8e4c-86096d7dfc97 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:48.848739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971447ab-7045-49d3-8e4c-86096d7dfc97 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:48.850115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:48.856374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38015b0b-d276-46ab-aa28-04503adc5d08 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:48.857377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38015b0b-d276-46ab-aa28-04503adc5d08 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:48.857377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38015b0b-d276-46ab-aa28-04503adc5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:48.876723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-38015b0b-d276-46ab-aa28-04503adc5d08 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:48.877973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-38015b0b-d276-46ab-aa28-04503adc5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:48.886288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:48.923539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971447ab-7045-49d3-8e4c-86096d7dfc97 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:48.942140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971447ab-7045-49d3-8e4c-86096d7dfc97 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:48.948263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:48.949167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:48.949509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:48.949848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:48.960573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:48.961957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd699fc-3bcb-4df9-a77b-cb6b59fa1e97 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:48.972249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 766/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:52.515213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:52.515912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:52.515912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:52.517159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:44:52.523042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3b060-7748-4e72-a02b-f6f1e2e5775a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:52.523568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3b060-7748-4e72-a02b-f6f1e2e5775a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:52.523568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3b060-7748-4e72-a02b-f6f1e2e5775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:52.534450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=62 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:44:52.549114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-acf3b060-7748-4e72-a02b-f6f1e2e5775a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:52.550366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-acf3b060-7748-4e72-a02b-f6f1e2e5775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:52.558470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:52.870055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:52.872793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:52.934181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad570106-53a0-453e-9540-1186b4cef8e5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:52.938439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:52.939096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:52.939371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:52.939656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:52.949332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:52.950787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90a64-f2d3-4e44-829a-0d4312453ad0 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:52.960493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 769/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:44:55.034361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:55.034955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:55.034955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:55.037000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 28 17:44:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:44:55.045181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6fb-9580-4456-9e08-b5c64f41da97 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:55.045651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6fb-9580-4456-9e08-b5c64f41da97 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:55.045746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6de6fb-9580-4456-9e08-b5c64f41da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:55.069809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1a6de6fb-9580-4456-9e08-b5c64f41da97 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:44:55.071063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1a6de6fb-9580-4456-9e08-b5c64f41da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:55.079889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 28 17:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:44:55.392625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:44:55.394751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:44:55.409935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ee29-516a-4dde-a084-d39cee7ff0f0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:44:55.417324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:44:55.418405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:44:55.418818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:44:55.419317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:44:55.435070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:44:55.436722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdb3e8-c946-4c28-bedb-2043239bfc0e service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:44:55.447056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 769/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:45:05.062525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=32 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:45:05.442313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=8 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:29.790796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:29.790796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:29.790796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:29.831205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:29.833284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:29.852733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 771/1540] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:29.864762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:29.865563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:29.865563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:29.904157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:29.905447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:29.923345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 770/1541] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:29.929047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:29.954128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5c0f5-7333-4aa7-80b5-5edf2da58c3c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:29.970388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:29.971572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:29.972276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:29.972771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:29.974353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:29.974889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:29.978180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.009382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 772/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:30.018171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.033317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4652e7d-ede0-447d-ad7d-eb1000744fd8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:30.043080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:30.043797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.044079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.044405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.045100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:30.047293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.098192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 771/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:30.103555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.125219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4a918-aef0-40dc-b31e-ad8dcfd28086 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:30.266247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:30.268335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.269247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.270040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.271985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:30.276544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.339603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 773/1544] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:30.343732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.363932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c8888-5dc9-4814-9bde-c92c02f73e21 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:30.374928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:30.375867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.376158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.376442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.377371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:30.379104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.399327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 772/1545] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:30.405263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.441053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa091e9-3e06-4e93-9b25-a15b74052b9d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:30.456246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:30.457861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.458740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.459490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.461170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:30.465362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab8c8-cc57-4e68-9b35-5ddb0647af29 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.491722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 774/1546] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:30.496547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.516833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47695ea-204f-4e76-9e83-44a150efbbcc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:30.524251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:30.525191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.525501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.525779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] PATH_INFO: `/v3/projects/607c2d028ef84f23bb7ab7be72b64f8f/users/832905930aa14f328e0d87f424afbaea/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.553032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=607c2d028ef84f23bb7ab7be72b64f8f, user_id=832905930aa14f328e0d87f424afbaea, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:30.556022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1749-2e0a-4b86-a160-392b8b124fae admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:30.584714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 773/1547] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:30 2022] PUT /identity/v3/projects/607c2d028ef84f23bb7ab7be72b64f8f/users/832905930aa14f328e0d87f424afbaea/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:30.591754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4a3-7fc8-4444-b239-0c57fa23180e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.592640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4a3-7fc8-4444-b239-0c57fa23180e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.593310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa4a3-7fc8-4444-b239-0c57fa23180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.633691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.634030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.634285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.647150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1c8fa4a3-7fc8-4444-b239-0c57fa23180e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:30.649604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1c8fa4a3-7fc8-4444-b239-0c57fa23180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:30.678400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:30.679735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:30.831323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 775/1548] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:30.833067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3438-a92d-4ed7-ac45-55a9483cae26 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.833430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3438-a92d-4ed7-ac45-55a9483cae26 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.833741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3438-a92d-4ed7-ac45-55a9483cae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.879324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-654f3438-a92d-4ed7-ac45-55a9483cae26 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:30.880938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-654f3438-a92d-4ed7-ac45-55a9483cae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:30.889354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:46:30.890768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:30.901277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 776/1550] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:30.915591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7890db-652d-473f-95e7-ef6886970516 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.915917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7890db-652d-473f-95e7-ef6886970516 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.916130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7890db-652d-473f-95e7-ef6886970516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:30.958834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6f7890db-652d-473f-95e7-ef6886970516 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:30.960102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6f7890db-652d-473f-95e7-ef6886970516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:30.987576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 777/1551] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 28 17:46:30.989194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:30.989484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:30.989761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.041240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.048245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.076359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 778/1552] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.078390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.084762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40746-0f54-45c5-a5ff-82e04e8be3df None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.101764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.103277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.103848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.104578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a232ba6-4661-4581-b3e7-50e2f6cf39e5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.104721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.117239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.118459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.118917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.119362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.121397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:31.122067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.125280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.138519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.145977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.163867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 779/1553] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:31.165028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.186638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 775/1554] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:31.194599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.195659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fc9b2-14fd-49de-a731-0bef4054e700 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.219453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.219453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.219453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.219453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.220298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:31.220298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.220298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc6ca2-8ec6-430c-b53d-09e345ac6732 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.237981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc748-3b0c-44f3-ad4e-ccb1fedc922c service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.274972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.276257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.279499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 780/1555] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:31.280210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.280898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.281629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.281830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.283125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.283633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.300828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297f227-2aeb-42fc-96eb-e8af55c76597 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.340619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.342140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.372379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 781/1556] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.373097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.417186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c18ce-8d4c-421c-84df-1c606cc5dd65 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.433239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 776/1557] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/projects => generated 393 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:31.437533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.438322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.438979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.439298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.439575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.440034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.440364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.441121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.446194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:31.446194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:46:31.446194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:46:31.446194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6d28b-7b7c-4b13-a1e1-2a958138c891 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.466047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:31.504134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.505386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.550213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 782/1558] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:31.558675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffe15-7a8a-40de-b356-f27a2303a2e9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.559229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffe15-7a8a-40de-b356-f27a2303a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.559965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffe15-7a8a-40de-b356-f27a2303a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.580171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:31.617662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-30dffe15-7a8a-40de-b356-f27a2303a2e9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.619826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-30dffe15-7a8a-40de-b356-f27a2303a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.730896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 777/1559] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.732663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.754636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f467e-e2dc-499f-9f95-32459100ee6b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.803027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 783/1560] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.804156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.804446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.804725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.833064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.835446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.846152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 784/1561] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.847369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:31.861004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd015-0412-467c-af1f-34d794f7bd21 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:31.870699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.871784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.872153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.872438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.873172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.875286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337472f-ad88-45f8-8925-500e85588b67 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.905022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 785/1562] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/users => generated 290 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:31.908736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f2df-5dbe-4b17-8918-5f41fcd8f410 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.908736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f2df-5dbe-4b17-8918-5f41fcd8f410 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.908736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f2df-5dbe-4b17-8918-5f41fcd8f410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.914443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:31.915954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.916384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.916974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.918660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:31.920027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:31.920027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:46:31.920027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:46:31.921706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77a881-9641-406b-8853-d2cf7732d062 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:31.930728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1868f2df-5dbe-4b17-8918-5f41fcd8f410 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.931961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1868f2df-5dbe-4b17-8918-5f41fcd8f410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.941432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 786/1563] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:31.942968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.943167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.943493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.982232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:31.985199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:31.988880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 778/1564] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:31.992693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:31.993375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:31.994026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:31.999986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 787/1565] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:32.001258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.015173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc8de9-5375-4839-9ca1-e8abbc29060e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.021220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.022470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.022985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.023546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.024582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:32.025073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.027127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f4f4d-e953-4191-a95c-7dae5842a091 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.034787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:32.038852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:32.045187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 788/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:32.046967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9535d6-b353-466e-bd0c-9eb32e8c8d5b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.047420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9535d6-b353-466e-bd0c-9eb32e8c8d5b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.047894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9535d6-b353-466e-bd0c-9eb32e8c8d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.067352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 779/1567] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:32.068678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.082242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7e9535d6-b353-466e-bd0c-9eb32e8c8d5b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:32.084596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7e9535d6-b353-466e-bd0c-9eb32e8c8d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:32.092491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8d7fd-3e5a-45c7-8105-53daa4a67818 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.096847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 789/1568] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:32.098963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da3f-0b65-47f9-bafb-8824ba084078 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.099585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da3f-0b65-47f9-bafb-8824ba084078 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.100183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65da3f-0b65-47f9-bafb-8824ba084078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.101073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.102286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.103035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.103204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.104683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.108282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.130106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ba65da3f-0b65-47f9-bafb-8824ba084078 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:32.131383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 780/1569] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:32.132435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ba65da3f-0b65-47f9-bafb-8824ba084078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:32.132760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.144256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 790/1570] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:32.146516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.147022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.147684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.151654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8199d-f1d4-4573-abbb-b4ab80e3f65c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.163342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.164488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.164947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.165390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.167065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.171077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.178150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:32.179874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:32.190297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 791/1571] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:32.192278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 781/1572] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:32.193613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.201132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.221680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac615ae-7d9a-440a-a3e8-1a12aae3e826 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.222684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a63d5-de5c-4754-890c-8e861013a3f2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.228296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.228905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.229055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.229347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.229613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.230508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:32.230913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.231379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.231877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.232144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:32.232144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:46:32.232144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:46:32.232614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.233069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.233873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.236375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.250023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 782/1573] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:32.250951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.262197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d51c-2375-48aa-906c-4a7f37fa351e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.268365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.269406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.269805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.270260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.271190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:32.271691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.273490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.280566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 792/1574] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:32.282903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.301990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 783/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:32.301990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.304425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d948974-0181-4642-a9c8-dc41761e3cd8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.375579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:32.392471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.394158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.395162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:32.395476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.395901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.397295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:32.398386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.402977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.405912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8468f-5143-4d7d-a6fd-f02010934364 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.414196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.415384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.415900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.416514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.418011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.419425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.434271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 784/1576] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:32.434271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.434677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 793/1577] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:32.434677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.444911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bd78-20aa-47c5-9b1c-d9517953cb32 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.446887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260affd-2872-4000-bd26-22cfecb3a314 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.451630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.452774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.452774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.453028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.453703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:32.454063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.454792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.455847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.456055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.457076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.457224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.459041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.462782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.483174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 794/1578] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:32.484671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.492497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 785/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:32.494036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.518049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c51a7-cc2e-4455-8642-a2e02aba224c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.524617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04ec9c-2ded-4f95-8b34-22c268ee79f4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.527431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.528575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.529002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.529373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.530376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.530755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.531435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.532062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.532701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.533510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.535609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.536228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.580689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 786/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/users => generated 287 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:32.580689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.592693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60aa6e-e06c-4d0d-aab9-8c042322d076 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.594505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 795/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:32.596218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.687678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a01b0-d164-414e-988c-354f9344cdc1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.694032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.696229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.696923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.697517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] PATH_INFO: `/v3/projects/de4e5238665642e48fbdf416791fea1c/users/716d438ebbcb49069bf9fe416559c846/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.721583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4e5238665642e48fbdf416791fea1c, user_id=716d438ebbcb49069bf9fe416559c846, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.723561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:32.723561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:46:32.723561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:46:32.726983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.748636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 796/1582] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:32 2022] PUT /identity/v3/projects/de4e5238665642e48fbdf416791fea1c/users/716d438ebbcb49069bf9fe416559c846/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:32.749920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.755160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.757400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.758473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.759228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.765823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:32.770235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:32.824601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 787/1583] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:32.825494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:32.896255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1664a8-8763-4654-9fb3-518d70ae897b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.977283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e902516-4363-48ad-a373-7063988a0008 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:32.990503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:32.992540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:32.993620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:32.994516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:32.996492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.001060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.008151 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:33.041452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.043901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.045401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.045401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.046087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.049489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.084749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 788/1584] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.086673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.108346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 797/1585] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:32 2022] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.108346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.170189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:33.236656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a6cb-bfbb-4488-ac85-a2a715767649 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.242349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.243816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.244360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.244816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] PATH_INFO: `/v3/projects/5f47c829c3cf4ae08a074953911d5f13/users/ad680eeeb787420d9bb421abdb42201a/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.244933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb0a6-30ab-4058-bed4-46c3dbaec61c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.254663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.256262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.256853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.257438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.259137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.263169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.268383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f47c829c3cf4ae08a074953911d5f13, user_id=ad680eeeb787420d9bb421abdb42201a, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.272151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2a787-003b-49bb-8b1e-e7d1850f299f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.287713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 798/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.289402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.300872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 789/1587] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:33 2022] PUT /identity/v3/projects/5f47c829c3cf4ae08a074953911d5f13/users/ad680eeeb787420d9bb421abdb42201a/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:33.302709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.302997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.303270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.317527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63865b-2bbd-4c87-95b3-73b205b0b64d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.343746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:33.346966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:33.428212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.429258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.429853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.430270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.431113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.433676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.469173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 799/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.471726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.491528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8543b31-cf05-42f8-837c-3ff591a7aed1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.497773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.498687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.499229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.499613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.501556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.505393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.530154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 790/1589] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:33.531505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.543541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 800/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.545566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.566358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d6baf-ee5e-4484-a97e-d695ac56a0a4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.567967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e33e0-64a4-4fb5-a44a-0fad9cbd39b0 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.573054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.574291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.574291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.575329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.575657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.576132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.576521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.576832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.577251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.578665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.578976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b9f77f-4d39-4548-98ae-696a70a87577 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.581558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.612829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 791/1591] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/users => generated 292 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.614289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.618617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 801/1592] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/users => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:33.618617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.618617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.618617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.636374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e530c9-b125-4bd5-881f-3deb3e986f6a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.643736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:33.645020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.645214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:33.646095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.646568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.646984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.648107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.651287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.657992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 802/1593] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:33.658999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.681164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 792/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.682224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab26e15-7e93-4c3f-9715-bf48afab3007 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.684546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.690483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.691884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.692378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.692991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.693966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.696819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.713280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950a6c-45aa-4265-a7c0-a395336cdffc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.723986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 803/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.725142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.726163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.727104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.727316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.727690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.728547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.733254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.743619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:33.753659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 793/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.753659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.767693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288569-1f8e-452d-989b-8ba4a9c4a429 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.777884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.779435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.779435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.779435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.780038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.782924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.809483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 794/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.811338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.829545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abddf89-6074-481f-97e7-cb57691d7600 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.839694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.841102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.841808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.842461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.843995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.848313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.853461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a553f-7d3f-4d77-a75f-eabee7b2105d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.859287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.860341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.860631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.860935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.877043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 795/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:33.877460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.877460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.877659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.897756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28d56-2553-42dd-98f7-7501b220812f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.905353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.906683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.907259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.908056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.911199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 804/1599] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:33.913515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.928506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:33.934342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:33.935010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d85d9a-6e1d-4cf9-976b-32603efaef32 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:33.941565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:33.942840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:33.943441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:33.943890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] PATH_INFO: `/v3/projects/a8fa721d933a429d885865efe5b775de/users/98bbab248dd3453aa9e0ed157a060a5e/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:33.959467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 796/1600] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:33.962460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:33.996011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f46edf-12f7-459f-b0a9-aaecb4364823 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.080451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fa721d933a429d885865efe5b775de, user_id=98bbab248dd3453aa9e0ed157a060a5e, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.080451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.090342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.090342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.090342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.090342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.091220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.091220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.091670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 805/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:33 2022] PUT /identity/v3/projects/a8fa721d933a429d885865efe5b775de/users/98bbab248dd3453aa9e0ed157a060a5e/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:34.091670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.091937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 797/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:34.091937 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.116649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84244763-3875-4bfd-b77a-8b16d98d7d14 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.190412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:34.275669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1e569-5efc-43cf-9668-7df0551a3109 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.285912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.287305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.288155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.288631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.290914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.297233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.317214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.319866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.319866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.319866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.321645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.326829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.329157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 806/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:34.331436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.354687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe6de8-a9cb-4499-a297-521b000ffef2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.361410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 798/1604] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:34.361410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.370510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.372192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.372852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.373632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.376240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.379596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a876dcf-46e9-4475-bb28-7622cc0c8857 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.385870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6427d4-21b9-4c5a-8514-7515e9a28564 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.396496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.399922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.400913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.401892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] PATH_INFO: `/v3/projects/ab4baeb669b543d9b9ade5f802083943/users/7dff2c94c92d45ddbc47202cf4b7dc9d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.408085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 807/1605] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:34.412870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.415818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.417078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.453997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4baeb669b543d9b9ade5f802083943, user_id=7dff2c94c92d45ddbc47202cf4b7dc9d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.463772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.491627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] MFA Rules not processed for user `98bbab248dd3453aa9e0ed157a060a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:34.493758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:34.505345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 799/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:34 2022] PUT /identity/v3/projects/ab4baeb669b543d9b9ade5f802083943/users/7dff2c94c92d45ddbc47202cf4b7dc9d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:34.506666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.662026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c84a32-3c2d-4b86-9ea0-2e38d1de5cd8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.671327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.672963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.673249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.673693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] PATH_INFO: `/v3/projects/ddc196d83175439babbd1360eb771ed3/users/b8215c04115a40c4b6f8eeebc53206d3/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:34.726548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc196d83175439babbd1360eb771ed3, user_id=b8215c04115a40c4b6f8eeebc53206d3, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:34.729288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:34.741607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:34.797051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 808/1607] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:34.799854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.839557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 800/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:34 2022] PUT /identity/v3/projects/ddc196d83175439babbd1360eb771ed3/users/b8215c04115a40c4b6f8eeebc53206d3/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:34.842999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:34.864323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d3c5-9c38-4a5f-8277-1facb6d23268 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.989174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba5447-5a47-4083-94bf-b0543fe20fe6 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:34.995380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:34.996459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:34.997408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:34.997408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] PATH_INFO: `/v3/projects/31be05f252c74868b1494fdb3e1cba73/users/1961aed4b8594e1e83ebbb25914455cc/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.018668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31be05f252c74868b1494fdb3e1cba73, user_id=1961aed4b8594e1e83ebbb25914455cc, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:35.022636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055f7ff-fc28-4e52-9495-f1886566365b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:35.051603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 801/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:34 2022] PUT /identity/v3/projects/31be05f252c74868b1494fdb3e1cba73/users/1961aed4b8594e1e83ebbb25914455cc/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:35.066561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc39c-16be-4eb7-9caa-5dc3f6cc0945 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.066561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc39c-16be-4eb7-9caa-5dc3f6cc0945 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.066561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bc39c-16be-4eb7-9caa-5dc3f6cc0945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.066561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:35.070464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:35.071514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.071790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.072074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] PATH_INFO: `/v3/projects/c9639852687e4b0eb961da5205c25b3d/users/7881178a1d1e404897d26b215fb11a53/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.168270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9639852687e4b0eb961da5205c25b3d, user_id=7881178a1d1e404897d26b215fb11a53, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:35.179638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149649b-7c9d-4bc7-82e9-23d6fa2860f8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:35.205098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e93bc39c-16be-4eb7-9caa-5dc3f6cc0945 None None] MFA Rules not processed for user `7dff2c94c92d45ddbc47202cf4b7dc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:35.212099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e93bc39c-16be-4eb7-9caa-5dc3f6cc0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:35.247670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 809/1610] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:34 2022] PUT /identity/v3/projects/c9639852687e4b0eb961da5205c25b3d/users/7881178a1d1e404897d26b215fb11a53/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:35.247670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520bf8-61f8-4882-a753-ee8dcf71306d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.247670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520bf8-61f8-4882-a753-ee8dcf71306d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.247670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520bf8-61f8-4882-a753-ee8dcf71306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.431154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-72520bf8-61f8-4882-a753-ee8dcf71306d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:35.432468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-72520bf8-61f8-4882-a753-ee8dcf71306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:35.504987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 802/1611] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:35.507518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ab964-bbd7-460e-a29a-67b6dcdd480c None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.508005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ab964-bbd7-460e-a29a-67b6dcdd480c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.508840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ab964-bbd7-460e-a29a-67b6dcdd480c None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.515584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 803/1612] 10.222.0.48 () {54 vars in 961 bytes} [Tue Jun 28 17:46:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:46:35.518743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0e085-e696-4475-975f-f6575e6564de None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.519235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0e085-e696-4475-975f-f6575e6564de None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.519709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0e085-e696-4475-975f-f6575e6564de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.580288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0db0e085-e696-4475-975f-f6575e6564de None None] MFA Rules not processed for user `1961aed4b8594e1e83ebbb25914455cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:35.582508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0db0e085-e696-4475-975f-f6575e6564de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:35.663730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 810/1613] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:35.667293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879fc13-99d6-4d98-b017-84ad7aee0f22 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.668072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879fc13-99d6-4d98-b017-84ad7aee0f22 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.668567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879fc13-99d6-4d98-b017-84ad7aee0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.736014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-e879fc13-99d6-4d98-b017-84ad7aee0f22 None None] MFA Rules not processed for user `7881178a1d1e404897d26b215fb11a53`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:35.738028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e879fc13-99d6-4d98-b017-84ad7aee0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:35.843438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 804/1614] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:35.845079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0e085-e696-4475-975f-f6575e6564de None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:35.907654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0e085-e696-4475-975f-f6575e6564de None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:35.950393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:35.953932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.954304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.954586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:35.958898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:35.968814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:35.993415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 811/1615] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:35.995622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6dd1-0acd-483a-a809-7d58ef4dca7b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:35.996161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6dd1-0acd-483a-a809-7d58ef4dca7b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:35.996638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c6dd1-0acd-483a-a809-7d58ef4dca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.028294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 805/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/projects => generated 405 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:36.029455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.032440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b27c6dd1-0acd-483a-a809-7d58ef4dca7b None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:36.034032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b27c6dd1-0acd-483a-a809-7d58ef4dca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:36.046226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:36.128146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4ace5-a3df-4cc6-b343-ff64d8c2360e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.140348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.141059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.141598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.142122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.178912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:36.236570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 812/1617] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Jun 28 17:46:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:36.238187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ceb8-e30b-4647-a98b-16d02bc8f6cf None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.238398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ceb8-e30b-4647-a98b-16d02bc8f6cf None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.238744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ceb8-e30b-4647-a98b-16d02bc8f6cf None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.248348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 813/1618] 10.222.0.48 () {54 vars in 961 bytes} [Tue Jun 28 17:46:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:46:36.249566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ceb8-e30b-4647-a98b-16d02bc8f6cf None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.272259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.273777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.280504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ceb8-e30b-4647-a98b-16d02bc8f6cf None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.311446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.313628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.313911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.317290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 806/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:36.317584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.319223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.321983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.322567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d96c4c-e4c1-43b8-9fa3-fb8a12af9679 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.342337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc0931-22d5-40c2-ae38-f2093aa218d9 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.353339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.355249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.356169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.372215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.410375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 814/1620] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:36 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:36.417545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a412b7-c757-477f-b795-f096699b6504 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.418193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a412b7-c757-477f-b795-f096699b6504 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.421394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a412b7-c757-477f-b795-f096699b6504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.459023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-76a412b7-c757-477f-b795-f096699b6504 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:36.461428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-76a412b7-c757-477f-b795-f096699b6504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:36.518036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 815/1621] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Jun 28 17:46:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:36.523078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a412b7-c757-477f-b795-f096699b6504 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.545079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.546826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.573058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a412b7-c757-477f-b795-f096699b6504 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.578707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 807/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:36.579746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.602233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.603428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.603932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.604336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.605477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.610772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12795279-24aa-4bc0-8daa-da41f4498973 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.615445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.625806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.629275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.629819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.630134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.666914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 816/1623] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:36.669597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.730302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f182b6-977c-48c6-91d5-defd8239d6b1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:36.774175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:36.775804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:36.776287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:36.776934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] PATH_INFO: `/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a/users/7db264f4360d4eba8d55c85886b3b393/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:36.842106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.851559 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.857599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6d2526b9a941d48e920370dc9a0f8a, user_id=7db264f4360d4eba8d55c85886b3b393, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:36.879288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:36.888454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 808/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:36.945500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 817/1625] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:36 2022] PUT /identity/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a/users/7db264f4360d4eba8d55c85886b3b393/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:36.946829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:36.968566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ce2d-36be-4e58-a23b-b27ad669868e service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:37.118590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:37.156660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:37.157376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:37.157662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:37.157954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:37.158888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:37.161148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3151b-8ab8-4f1e-ab41-e1b282fd8852 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:37.190126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 809/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:46:37.196646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:37.233633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a3b8-a2fc-40d5-b3e6-a0095baf4c48 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:37.255957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:37.257654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:37.258183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:37.258679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] PATH_INFO: `/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a/users/7db264f4360d4eba8d55c85886b3b393/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:37.271803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6d2526b9a941d48e920370dc9a0f8a, user_id=7db264f4360d4eba8d55c85886b3b393, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:37.283682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf69c02-1b5d-4a9a-a9f1-217a18f4dd00 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:37.323137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 818/1627] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:37 2022] PUT /identity/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a/users/7db264f4360d4eba8d55c85886b3b393/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:37.342140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:37.342429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:37.342874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:37.434694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] MFA Rules not processed for user `7db264f4360d4eba8d55c85886b3b393`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:37.436770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:37.540915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ced7-d5e1-48ec-b31a-8f7df153ef27 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:37.541419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ced7-d5e1-48ec-b31a-8f7df153ef27 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:37.541880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ced7-d5e1-48ec-b31a-8f7df153ef27 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:37.544892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 819/1628] 10.222.0.48 () {54 vars in 912 bytes} [Tue Jun 28 17:46:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:46:37.552650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:37.553115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:37.553588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:37.653526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:37.669658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:37.759750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 810/1629] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:46:37.762953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:37.907713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 820/1630] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:46:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:37.913708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:37.952499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:38.013468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a2891-9425-44fc-bf4b-db97a58ba72f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:38.021803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:38.023030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.024051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.024534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.049013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60022d-daf2-4dbc-a35c-2d5f1c3bb1d6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:38.063913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:38.064708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.065223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.065558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.092070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:38.094718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:38.113113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:38.115367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d65f-a25b-46ea-93c3-6030ea99aff4 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:38.125599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 821/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:38.126626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:38.142190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 811/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:38.151143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edaee7-471f-4aa3-93df-ea06cf7b0f7a service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:38.163985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:38.164669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.164949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.165226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.189276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6356-b586-4058-868e-a77085bbda52 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.190083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6356-b586-4058-868e-a77085bbda52 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.190542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd6356-b586-4058-868e-a77085bbda52 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.195279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:38.196245 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 812/1633] 10.222.0.48 () {54 vars in 912 bytes} [Tue Jun 28 17:46:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:46:38.200447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:38.209692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.210694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.211163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.228143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:38.248122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:38.256001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:38.261678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 822/1634] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:38.297727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 813/1635] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:46:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:38.352078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:38.364523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233abb-74df-4ca1-ba8f-907aa5fc2a12 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:38.377712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:38.378510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:38.378779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:38.379053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:38.407095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:38.411138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:38.492183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 823/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:39.466715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:39.835489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa1ded-2eba-4a91-84d8-a0c0b73bddcf None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:39.846953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:39.848543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:39.849058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:39.849671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] PATH_INFO: `/v3/users/7dff2c94c92d45ddbc47202cf4b7dc9d` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:39.852323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dff2c94c92d45ddbc47202cf4b7dc9d)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:39.856955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:39.984795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:39.991269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dff2c94c92d45ddbc47202cf4b7dc9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:39.993030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dff2c94c92d45ddbc47202cf4b7dc9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:39.993919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dff2c94c92d45ddbc47202cf4b7dc9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.008606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e87e4-f2ea-49e5-a40a-b2f8039fad2e service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:40.021765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:40.021765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:40.022091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:40.027248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dff2c94c92d45ddbc47202cf4b7dc9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.027859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] PATH_INFO: `/v3/users/1961aed4b8594e1e83ebbb25914455cc` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:40.033346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1961aed4b8594e1e83ebbb25914455cc)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:40.036259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: WARNING py.warnings [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:40.036259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: warnings.warn(msg) Jun 28 17:46:40.036259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: Jun 28 17:46:40.046989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:40.055215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8532c3f6-52dd-4e1d-b4f7-9426d30c1967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dff2c94c92d45ddbc47202cf4b7dc9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.133709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 814/1637] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:39 2022] DELETE /identity/v3/users/7dff2c94c92d45ddbc47202cf4b7dc9d => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:40.137620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815c70c-adf6-4a3a-a835-54889b015d8f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:40.138161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815c70c-adf6-4a3a-a835-54889b015d8f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:40.139950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815c70c-adf6-4a3a-a835-54889b015d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:40.235565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2815c70c-adf6-4a3a-a835-54889b015d8f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:40.238734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2815c70c-adf6-4a3a-a835-54889b015d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:40.251481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1961aed4b8594e1e83ebbb25914455cc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.275667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1961aed4b8594e1e83ebbb25914455cc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.279394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1961aed4b8594e1e83ebbb25914455cc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.309054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1961aed4b8594e1e83ebbb25914455cc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.404081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1961aed4b8594e1e83ebbb25914455cc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:40.428085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 815/1638] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:40.451572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 824/1639] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:39 2022] DELETE /identity/v3/users/1961aed4b8594e1e83ebbb25914455cc => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:40.460715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:40.461053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:40.461342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:40.493861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:40.497229 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:40.527286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:40.529503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:40.628467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:40.826102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 816/1640] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:40.864499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1800ca-7f9c-49d1-9bbe-4cd67a2a713e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:40.907518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:40.911706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:40.918356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:40.923986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:40.924516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:40.930384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:40.946826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc06a9-936e-4fc6-96ad-b68060fc73b8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:40.963405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:40.966208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:40.966505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:40.966943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:41.000586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:41.007953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:41.016830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:41.018658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:41.081338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 817/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:41.106411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 825/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:46:42.749778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:42.751621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:42.779882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20c0eb-088d-45f5-abc2-7561e9b44a00 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:42.795884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:42.797120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:42.797589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:42.798074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] PATH_INFO: `/v3/projects/31be05f252c74868b1494fdb3e1cba73` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:42.799771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31be05f252c74868b1494fdb3e1cba73)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:42.801011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: WARNING py.warnings [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 28 17:46:42.801011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: warnings.warn(msg) Jun 28 17:46:42.801011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: Jun 28 17:46:42.811440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:42.877173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:42.880052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:42.922313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23755d-18e4-4581-9961-5fc16168c411 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:42.947880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:42.952008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:42.955961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:42.956714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] PATH_INFO: `/v3/users/98bbab248dd3453aa9e0ed157a060a5e` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:42.963786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bbab248dd3453aa9e0ed157a060a5e)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:42.973262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:42.973464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31be05f252c74868b1494fdb3e1cba73', 'request_id': 'req-dd7c0379-d565-449b-8dfb-5f6be2645abd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:42.989160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31be05f252c74868b1494fdb3e1cba73', 'request_id': 'req-dd7c0379-d565-449b-8dfb-5f6be2645abd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.003263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:43.042331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31be05f252c74868b1494fdb3e1cba73', 'request_id': 'req-dd7c0379-d565-449b-8dfb-5f6be2645abd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.077689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] The token cache is being invalidate because project 31be05f252c74868b1494fdb3e1cba73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:46:43.078101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.083604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-dd7c0379-d565-449b-8dfb-5f6be2645abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.085737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 818/1643] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:46:42 2022] DELETE /identity/v3/projects/31be05f252c74868b1494fdb3e1cba73 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:43.091318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d887-1a62-4c11-b91d-1cf118447030 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.091699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d887-1a62-4c11-b91d-1cf118447030 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.092145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96d887-1a62-4c11-b91d-1cf118447030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.108640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bbab248dd3453aa9e0ed157a060a5e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.128601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bbab248dd3453aa9e0ed157a060a5e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.131878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bbab248dd3453aa9e0ed157a060a5e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.137720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ed96d887-1a62-4c11-b91d-1cf118447030 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:43.142857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ed96d887-1a62-4c11-b91d-1cf118447030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:43.152390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bbab248dd3453aa9e0ed157a060a5e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.187532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b3e3d46b-52cd-419e-88bd-4ee2bc0d84e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bbab248dd3453aa9e0ed157a060a5e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:43.208160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 826/1644] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:42 2022] DELETE /identity/v3/users/98bbab248dd3453aa9e0ed157a060a5e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:43.213191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.213480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.213757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.254965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 819/1645] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:43.276205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.278242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.278522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:43.278802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.279812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:43.367734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:43.383231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:43.495019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:43.540140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 827/1646] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:46:43.576520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:43.580257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:43.760099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 820/1647] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:43.763262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:43.813607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4554da-c284-4dbc-8a40-a8e3415cf1e2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:43.815952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fb76a-f904-4bed-8e71-a4b62bc11549 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:43.835761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:43.836941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:43.837506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.838181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.838866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.840634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.841231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.842622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.859931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:43.860724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:43.868684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:43.872839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:43.881281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:43.912186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 828/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:46:43.947849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:43.948840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 821/1649] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:43.966316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af148-121d-4674-b46b-980c94e819f9 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:43.984403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:43.985770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:43.986248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:43.987632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:43.988668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:43.990977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.081065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 829/1650] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:43 2022] POST /identity/v3/projects => generated 357 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:44.087856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:44.112333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9417cc-fd84-4634-8ec7-c2219e643f28 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:44.216928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:44.218207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.218701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.219152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.220216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:44.222555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.258411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 822/1651] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:44 2022] POST /identity/v3/users => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:44.263566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:44.274402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:44.293626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1cf6c-0777-425e-988c-ccf7146e8c40 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:44.306103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:44.306895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.307183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.309678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.311436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:44.313428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.349721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:44.359133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 830/1652] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:46:44.367490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7bca-f95b-4415-a01e-ae7c746857f2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:44.384428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:44.385873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.387110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.387810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.388907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:44.392278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.416487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 823/1653] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:44.419472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:44.447445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838230-c8b6-4a1a-b30e-50c4b866a00f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:44.469436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:44.471786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.472825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.473591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] PATH_INFO: `/v3/projects/44427c1ac66b470fbbadbf5ebbeccd4d/users/4edb203e031f4374a5b38b7217b2c05b/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.536341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44427c1ac66b470fbbadbf5ebbeccd4d, user_id=4edb203e031f4374a5b38b7217b2c05b, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:44.551024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d944f3-0358-44a6-9e10-f31efd5d9dcd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.603062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:44.608061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:44.643376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 831/1654] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:44 2022] PUT /identity/v3/projects/44427c1ac66b470fbbadbf5ebbeccd4d/users/4edb203e031f4374a5b38b7217b2c05b/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:44.652434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.654873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.654873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.671218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cace8d-3d30-41c8-baac-a2059444665d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:44.742172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] MFA Rules not processed for user `4edb203e031f4374a5b38b7217b2c05b`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:44.746180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:44.831269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:44.840447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:44.841029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:44.841474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] PATH_INFO: `/v3/projects/ab4baeb669b543d9b9ade5f802083943` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:44.843321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4baeb669b543d9b9ade5f802083943)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:44.847139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:44.928572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:44.961484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4baeb669b543d9b9ade5f802083943', 'request_id': 'req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:44.974939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4baeb669b543d9b9ade5f802083943', 'request_id': 'req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:44.990563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4baeb669b543d9b9ade5f802083943', 'request_id': 'req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.025322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] The token cache is being invalidate because project ab4baeb669b543d9b9ade5f802083943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:46:45.025709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.028283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.032269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 824/1655] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:46:44 2022] DELETE /identity/v3/projects/ab4baeb669b543d9b9ade5f802083943 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:45.037209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:45.040986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:45.062225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 832/1656] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:44 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:46:45.072413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:45.147300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b722a-3070-47c8-a245-f7f8349c8879 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:45.278915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1480cf6-23ca-4faa-a01d-5e8c51bc0807 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:45.292248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:45.294326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:45.296882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:45.297219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] PATH_INFO: `/v3/users/7db264f4360d4eba8d55c85886b3b393` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:45.301083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db264f4360d4eba8d55c85886b3b393)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:45.304549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:45.412971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:45.415572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:45.416565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:45.417428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:45.419226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:45.428643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:45.439380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db264f4360d4eba8d55c85886b3b393'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.440057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db264f4360d4eba8d55c85886b3b393'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.442310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db264f4360d4eba8d55c85886b3b393'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.467655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db264f4360d4eba8d55c85886b3b393'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.489904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db264f4360d4eba8d55c85886b3b393'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:45.546456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 825/1657] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:45 2022] DELETE /identity/v3/users/7db264f4360d4eba8d55c85886b3b393 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:45.555947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:45.558022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:45.632595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 833/1658] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:45 2022] POST /identity/v3/projects => generated 355 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:45.639595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:45.644121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:45.704045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:45.737586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1018f85-6b6c-467d-bf62-61cd24717558 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:45.847638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:45.850823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:45.853677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:45.858260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:45.858816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] PATH_INFO: `/v3/projects/a8fa721d933a429d885865efe5b775de` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:45.862190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fa721d933a429d885865efe5b775de)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:45.864659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:45.890614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcebdd-474b-4356-83a9-0dcfe7d815ed admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:45.900217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:45.901878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:45.902615 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:45.903279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:45.904891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:45.910346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:45.973917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 834/1659] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:45 2022] POST /identity/v3/users => generated 284 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:45.976010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:45.982634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:46.009191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066c854-341d-438c-a58b-3f2c72623307 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:46.024304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fa721d933a429d885865efe5b775de', 'request_id': 'req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.041509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fa721d933a429d885865efe5b775de', 'request_id': 'req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.060941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fa721d933a429d885865efe5b775de', 'request_id': 'req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.100195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] The token cache is being invalidate because project a8fa721d933a429d885865efe5b775de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:46:46.100886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.103206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.110473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 826/1660] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:46:45 2022] DELETE /identity/v3/projects/a8fa721d933a429d885865efe5b775de => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:46.113047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:46.123381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:46.176483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:46.180965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.185278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.186236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] PATH_INFO: `/v3/users/7881178a1d1e404897d26b215fb11a53` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:46.188039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7881178a1d1e404897d26b215fb11a53)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:46.192507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:46.372943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab1bde-70c8-49ab-83eb-1d1fe6bfd014 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:46.397221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:46.403806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.404385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.407071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:46.412045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:46.413053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7881178a1d1e404897d26b215fb11a53'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.423209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1620c7-96d3-4e9f-a852-cede99e120cb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:46.454421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7881178a1d1e404897d26b215fb11a53'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.458680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7881178a1d1e404897d26b215fb11a53'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.507570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7881178a1d1e404897d26b215fb11a53'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.514199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 827/1661] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:46.536546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.536546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.536787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:46.579717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7881178a1d1e404897d26b215fb11a53'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:46.614698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 835/1662] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:45 2022] DELETE /identity/v3/users/7881178a1d1e404897d26b215fb11a53 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:46.623676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:46.630746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:46.638583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:46.642872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:46.713788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:46.866650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:46.886928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 828/1663] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:46.890138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:46.892378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:46.911650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a48b7-e320-4eb5-a0d3-bb95077bfdaa admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:46.916801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7e991-9610-4481-a70d-8c227c4db3be None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:46.927863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:46.929071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:46.929570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.930177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.930702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] PATH_INFO: `/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03/users/fb4aeb8e79e3466999ecc26e6e886852/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:46.932906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.933560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.934984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] PATH_INFO: `/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:46.939788 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6d2526b9a941d48e920370dc9a0f8a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:46.946660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:46.951356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fa2d0a96484f2a9e8f07e8c5affd03, user_id=fb4aeb8e79e3466999ecc26e6e886852, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:46.954476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73758c7-846d-4c63-b29e-954dee0c09cf admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:46.980230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 836/1664] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:46 2022] PUT /identity/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03/users/fb4aeb8e79e3466999ecc26e6e886852/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:46.989399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:46.989704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:46.989979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.044570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:47.045868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6d2526b9a941d48e920370dc9a0f8a', 'request_id': 'req-98e7a4dc-f0f2-426b-83c5-f878345a76cb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:47.046393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.055475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6d2526b9a941d48e920370dc9a0f8a', 'request_id': 'req-98e7a4dc-f0f2-426b-83c5-f878345a76cb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:47.064636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6d2526b9a941d48e920370dc9a0f8a', 'request_id': 'req-98e7a4dc-f0f2-426b-83c5-f878345a76cb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:47.123284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] The token cache is being invalidate because project cd6d2526b9a941d48e920370dc9a0f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:46:47.123732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:47.125227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-98e7a4dc-f0f2-426b-83c5-f878345a76cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:47.135010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 829/1665] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:46:46 2022] DELETE /identity/v3/projects/cd6d2526b9a941d48e920370dc9a0f8a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:47.139495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d1f4-f034-43c1-9bca-9545c92ee99d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.140167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d1f4-f034-43c1-9bca-9545c92ee99d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.142633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834d1f4-f034-43c1-9bca-9545c92ee99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.205279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9834d1f4-f034-43c1-9bca-9545c92ee99d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:47.206811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9834d1f4-f034-43c1-9bca-9545c92ee99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.209880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 837/1666] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:47.210972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.215439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.233487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 830/1667] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:47.235160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.235464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.236208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.240065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b66146-9efb-416c-b1f7-b9b44ceaca56 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:47.255025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:47.255891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.257101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.257101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.257520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:47.259386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:47.278107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:47.279956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.290203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 838/1668] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:47.292091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.295820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.322132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 831/1669] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:47.322132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.343028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163c5e-63f4-4b15-be4d-f69aba47fd52 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:47.372803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:47.377450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.377874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.378357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.380952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:47.381375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:47.386724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:47.421177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 832/1670] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:47.428235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.439756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63626c-9fb7-4a2a-a98c-ba0c6ef88a8f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:47.454940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86f8c8-49d3-4394-b5c8-6631afbf52d9 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:47.455124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:47.455746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.456125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.456630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.469193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:47.470339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.470695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.471042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] PATH_INFO: `/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03/users/fb4aeb8e79e3466999ecc26e6e886852/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.477513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fa2d0a96484f2a9e8f07e8c5affd03, user_id=fb4aeb8e79e3466999ecc26e6e886852, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:47.480553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bfeb8-2b12-4ecb-9cba-ca5262268445 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:47.482318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:47.485148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:47.523017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 833/1671] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:47 2022] PUT /identity/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03/users/fb4aeb8e79e3466999ecc26e6e886852/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:47.524324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98708-ace3-4bd4-86e4-bee7858bee4b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.526822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98708-ace3-4bd4-86e4-bee7858bee4b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.527215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d98708-ace3-4bd4-86e4-bee7858bee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.536039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 839/1672] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:47.536806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.548542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f2e73-d91a-4290-b897-33cece3c1035 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:47.580028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-76d98708-ace3-4bd4-86e4-bee7858bee4b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:47.581558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-76d98708-ace3-4bd4-86e4-bee7858bee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.706908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:47.707628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.707922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.708204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.708934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:47.711021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:47.740596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:47.767698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 834/1673] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:47.772667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:47.772667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:47.772667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:47.784898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:47.801248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 840/1674] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:47 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:47.805698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:47.850675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] MFA Rules not processed for user `fb4aeb8e79e3466999ecc26e6e886852`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:47.855171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:47.987550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91392c9-ab79-428b-9462-ebba6693ef5f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.000182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.001153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.001584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.002029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.003041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:48.004441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.009963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.040510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 841/1675] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:48.042346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.071338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fedc0-d9f7-42c9-ba94-6486ab9d5b37 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.076865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 835/1676] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:47 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:48.079212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.092499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.093334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.093622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.093903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.094729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.097066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.140545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637241-6072-48f0-847a-b3ac6098aed6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.143454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 842/1677] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:48 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:48.144544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.148724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:48.152436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.153805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.154425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.154911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.157598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.164873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.290370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a2311-8093-4dcd-b870-6b319a1e9a91 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.307409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 836/1678] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:48 2022] POST /identity/v3/projects => generated 405 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:48.312615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.478396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9f65-f00f-477b-8dca-edfe1c280e5a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.481797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.483364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.484146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.484245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.491316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.492131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.492424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.492711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.493846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.497489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.530816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 837/1679] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:48.531904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.557167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22c13-9f45-472a-af73-989c51df45de admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.572791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.573782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.574106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.574399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.575152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.577807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.634029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:48.636612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 838/1680] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:48 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:48.640431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.696743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2000-2a87-459a-bc76-e361c789890d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.698771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.700673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.720437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.726654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 843/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:48 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:48.727658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.729773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.730616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.739099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.744567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.750555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076d7dc-f22f-4377-bb47-776394784c2d service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.755955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.762388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.763099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.763382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.763660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.764414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.768268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.803942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 844/1682] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:48.807984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.825299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 839/1683] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:48.826970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.830947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c7694-adf3-44e8-8c69-ef521178048b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.848167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.848919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.849192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.849483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.850425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.852162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.869382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577674e-0d0c-4fc2-9583-725b02adbaed admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.886807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 845/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:46:48.893114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:48.898409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.904129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.904815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.905277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] PATH_INFO: `/v3/projects/a5964d07db2e473f9be8a0b04182fce5/users/108b956653c84909bc509ab6cd8d8914/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.923881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d722a-c3e9-4230-bb0e-5f3c1e0ab418 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:48.930920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:48.932644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:48.933560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:48.934367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] PATH_INFO: `/v3/projects/e7b63f4253b746caa7f567dac98cfbf2/users/fcca6dff4370492f8af122b3f3a4e54d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:48.972799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b63f4253b746caa7f567dac98cfbf2, user_id=fcca6dff4370492f8af122b3f3a4e54d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.979455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac874a-6ca7-4b14-8b4c-2368ed7be3a7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:48.982394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5964d07db2e473f9be8a0b04182fce5, user_id=108b956653c84909bc509ab6cd8d8914, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:48.988338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f05b7c-3ec3-4974-9615-e6fec0fa69fd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:49.019738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 840/1685] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:48 2022] PUT /identity/v3/projects/a5964d07db2e473f9be8a0b04182fce5/users/108b956653c84909bc509ab6cd8d8914/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:49.025411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 846/1686] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:48 2022] PUT /identity/v3/projects/e7b63f4253b746caa7f567dac98cfbf2/users/fcca6dff4370492f8af122b3f3a4e54d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:49.038708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:49.040453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:49.041260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:49.051299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:49.052423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:49.053023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:49.151801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:49.157664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:49.181005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] MFA Rules not processed for user `108b956653c84909bc509ab6cd8d8914`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:49.181988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:49.189521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:49.359060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 847/1687] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:49.359060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:49.430553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 841/1688] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:49.430553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:49.435446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:49.488167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0b39-f897-420e-9b49-8df9146f0348 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:49.493884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:49.494625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:49.494964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:49.495245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:49.507238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:49.594193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:49.661828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:49.663428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:49.685777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 848/1689] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:49.686598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:49.743681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210548f1-50f8-418e-b080-21b5ea2bbe8f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:49.780520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:49.781706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:49.786012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:49.786478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:49.822606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b915e-ff00-494c-a9a2-df0f23406bd6 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:49.824099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:49.827282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99068eed-43dd-4319-b38a-19bad27f13bd service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:49.830817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:49.831551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:49.831834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:49.832116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:49.871392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:49.872898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:49.889106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 842/1690] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:49.906505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 849/1691] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:50.718791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4978c3-2dec-4362-b113-b4326eccefa0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:50.720205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4978c3-2dec-4362-b113-b4326eccefa0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:50.721010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4978c3-2dec-4362-b113-b4326eccefa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:50.758116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:50.766739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:50.846736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d8a5-1835-4c86-81e7-f7b5e78e57de service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:50.871696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:50.873705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:50.875214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:50.875869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] PATH_INFO: `/v3/projects/c9639852687e4b0eb961da5205c25b3d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:50.884148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9639852687e4b0eb961da5205c25b3d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:50.895894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:50.913440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-de4978c3-2dec-4362-b113-b4326eccefa0 None None] MFA Rules not processed for user `b8215c04115a40c4b6f8eeebc53206d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:50.917541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-de4978c3-2dec-4362-b113-b4326eccefa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:51.091600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9639852687e4b0eb961da5205c25b3d', 'request_id': 'req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:51.143138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9639852687e4b0eb961da5205c25b3d', 'request_id': 'req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:51.172661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 843/1692] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:51.178053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277572-3020-4b8d-90e5-133c6db9bfac None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:51.178586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277572-3020-4b8d-90e5-133c6db9bfac None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:51.179109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277572-3020-4b8d-90e5-133c6db9bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:51.179232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9639852687e4b0eb961da5205c25b3d', 'request_id': 'req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:51.212834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] The token cache is being invalidate because project c9639852687e4b0eb961da5205c25b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:46:51.213364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:51.215916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:51.229385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 850/1693] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:46:50 2022] DELETE /identity/v3/projects/c9639852687e4b0eb961da5205c25b3d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:46:51.232793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:51.235778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:51.273725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-74277572-3020-4b8d-90e5-133c6db9bfac None None] MFA Rules not processed for user `832905930aa14f328e0d87f424afbaea`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:51.277153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-74277572-3020-4b8d-90e5-133c6db9bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:51.376904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:51.438402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:51.522373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfbcf3-85b9-46b3-945b-d00f0e46cee3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:51.531187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 844/1694] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:51.531672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:51.532920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:51.533605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:51.534195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:51.537131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:51.537338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:51.537707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:51.538014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:51.660380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:51.662834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:52.012174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.016920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be95a22-f43a-4ae6-ab62-d046faf5f7d9 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:52.018648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 845/1695] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:52.022142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:52.027052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:52.085578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 851/1696] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 855 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:52.094862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292bb40-f391-4edb-9896-cc81a1ad5477 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.095370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292bb40-f391-4edb-9896-cc81a1ad5477 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.096096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292bb40-f391-4edb-9896-cc81a1ad5477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.154353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba54a02-dd0e-447a-97b2-0f0768a2547f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:52.169961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f292bb40-f391-4edb-9896-cc81a1ad5477 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:52.172182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f292bb40-f391-4edb-9896-cc81a1ad5477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:52.174600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:52.175400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.175770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.176118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.222857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.237587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 852/1697] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:52.240160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.240646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.241139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.245476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:52.290975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 846/1698] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:52.292065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:52.346950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61376864-9bb2-47e7-9a87-aaaa59d71779 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:52.378197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] MFA Rules not processed for user `fcca6dff4370492f8af122b3f3a4e54d`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:52.382545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:52.395145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:52.396118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.396545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.396992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.397904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:46:52.398415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.400311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:52.446050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 847/1699] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:46:52.450963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:52.475814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b8a4-a89a-46a0-a151-046549773efb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:52.497862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:52.498972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.499358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.500509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.501380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.505296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:52.576976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 848/1700] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:52 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:52.582791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:52.610851 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 853/1701] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:52.616564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:52.618142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:52.661771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf34331-ddb4-4f4b-adf6-377c1bfa1ab6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:52.897608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bdd0c-e85a-40be-b9da-ca2fe4a625cb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:52.917805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:52.919793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.924085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.924542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.925710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.929304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:52.972910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:52.978087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:52.979009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:52.979824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:52.985512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:52.998959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.007589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 849/1702] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:52 2022] POST /identity/v3/users => generated 282 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:53.014550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.048695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211c08c-82c5-45e5-9c9c-d8e1e09b1150 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:53.086902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:53.090490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:53.091294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:53.120162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:53.122436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:53.126218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.190876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 850/1703] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:53.194354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 854/1704] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:52 2022] POST /identity/v3/projects => generated 403 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:53.194890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.198551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.235739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:53.237700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:53.261557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c202b-4135-44d5-a956-1ccb17e54026 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:53.653400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed15e25-1a48-46fb-94f7-643359424f6b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:53.661185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:53.662029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:53.662272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:53.662697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:53.663481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:53.670315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.680741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:53.681672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:53.682169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:53.682795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:53.684006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:53.696747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.701700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 851/1705] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:53.707609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.743858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286dd5f-081f-4f0d-9a2e-41f5f6eeea89 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:53.763615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:53.765105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:53.765480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:53.765718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] PATH_INFO: `/v3/projects/a65fc9ea4d5c4d1ab50875a22f13167e/users/2268f6a45f854d6293bbe18999432920/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:53.818117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 855/1706] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:53 2022] POST /identity/v3/users => generated 308 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:53.827733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.863580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9428e-3cb1-4833-96a2-70d11e663a5b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:53.888719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:53.891133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:53.895022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:53.895633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:53.899380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:53.901372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65fc9ea4d5c4d1ab50875a22f13167e, user_id=2268f6a45f854d6293bbe18999432920, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:53.908092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.913597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2995b-2d4d-4343-bf9a-0af220ebd5fa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:53.940768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 856/1707] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:53.949799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:53.997148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 852/1708] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:53 2022] PUT /identity/v3/projects/a65fc9ea4d5c4d1ab50875a22f13167e/users/2268f6a45f854d6293bbe18999432920/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:54.005707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:54.014060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:54.016137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:54.049827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c42c-bb09-4608-b718-d3b11194073b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:54.129491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] MFA Rules not processed for user `2268f6a45f854d6293bbe18999432920`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:54.131729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:54.224864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:54.227423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:54.228266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:54.228266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] PATH_INFO: `/v3/projects/a7d0078a2db04d749b29db8ed3b72158/users/699430b464024375901c098973c4b225/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:54.270637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d0078a2db04d749b29db8ed3b72158, user_id=699430b464024375901c098973c4b225, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:54.281805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:54.338257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 857/1709] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:53 2022] PUT /identity/v3/projects/a7d0078a2db04d749b29db8ed3b72158/users/699430b464024375901c098973c4b225/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:54.340978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:54.471569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 853/1710] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:54.473467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:54.565138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff958ee6-06c9-4f4f-86fe-75f7599d084f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:54.696368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cf328-32ce-4a78-a14a-a2c5ce907aa8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:54.717813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:54.718911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:54.719395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:54.719849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:54.721028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:54.723793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:54.781595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 858/1711] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:54.795283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:54.825785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:54.845242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5b0c7-26e2-4ea4-a203-68eb7e3c1fae admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:54.859290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:54.860423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:54.860859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:54.862468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] PATH_INFO: `/v3/projects/a7d0078a2db04d749b29db8ed3b72158/users/699430b464024375901c098973c4b225/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:54.869998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d0078a2db04d749b29db8ed3b72158, user_id=699430b464024375901c098973c4b225, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:54.875426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:54.911469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 859/1712] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:54 2022] PUT /identity/v3/projects/a7d0078a2db04d749b29db8ed3b72158/users/699430b464024375901c098973c4b225/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:54.917916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:54.920636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:54.921091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:54.921414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:54.922840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:54.925874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:54.969644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:55.003623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 854/1713] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:46:54 2022] POST /identity/v3/projects => generated 365 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:46:55.009675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:55.219991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec797d2-53ad-4282-af1c-dced2126fa50 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:55.456449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:55.457248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:55.457536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:55.457876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:55.458814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:55.473256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:55.551433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 860/1714] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:46:55 2022] POST /identity/v3/users => generated 289 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:46:55.556154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:55.579436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00258ae5-a34a-4de5-a284-0a49855853a5 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:55.599759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:55.606749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:55.607060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:55.607337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:55.612350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:55.623040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:55.683458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 855/1715] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:55.685465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:55.708639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ade72c-ac00-4439-a2c4-05d49b88e1cb admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:55.726197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:55.727162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:55.731680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:55.731988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] PATH_INFO: `/v3/projects/95127c088f674193aa7223df614e29b5/users/5688dcb491e6468ca2951b0e1ede157c/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:55.795128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95127c088f674193aa7223df614e29b5, user_id=5688dcb491e6468ca2951b0e1ede157c, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:55.800671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:55.952922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 861/1716] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:55 2022] PUT /identity/v3/projects/95127c088f674193aa7223df614e29b5/users/5688dcb491e6468ca2951b0e1ede157c/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:55.958988 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:56.032607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105284cd-6610-4c71-af7e-dcbcaac9ebbf admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:56.236294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:56.237104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:56.237384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:56.237649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:56.238526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:56.248796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378b7b3-06cc-40f8-985f-b93f954d92b4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:56.277574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 856/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:46:56.281175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:56.333604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a07cc7-c733-4ec1-93e5-a5c25e421432 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:56.340651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:56.342249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:56.342750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:56.343333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] PATH_INFO: `/v3/projects/95127c088f674193aa7223df614e29b5/users/5688dcb491e6468ca2951b0e1ede157c/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:56.349197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95127c088f674193aa7223df614e29b5, user_id=5688dcb491e6468ca2951b0e1ede157c, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:56.362936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:56.389285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 862/1718] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:46:56 2022] PUT /identity/v3/projects/95127c088f674193aa7223df614e29b5/users/5688dcb491e6468ca2951b0e1ede157c/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:56.399936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c4b0-af60-4926-b32a-cded349885a3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:56.400203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c4b0-af60-4926-b32a-cded349885a3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:56.400398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c4b0-af60-4926-b32a-cded349885a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:56.491884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4ba0c4b0-af60-4926-b32a-cded349885a3 None None] MFA Rules not processed for user `5688dcb491e6468ca2951b0e1ede157c`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:56.497051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4ba0c4b0-af60-4926-b32a-cded349885a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:56.741310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 857/1719] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:56.754566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:56.756875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:57.046581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:57.075825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed170a-8ec2-492a-b013-5f13eec069d7 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:57.095665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:57.100042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:57.100538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:57.102344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:57.147614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:57.154828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c6fe-3ff8-448f-8501-72ac8eef435a service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:57.193482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 863/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:57.606550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:57.607444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:57.609137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:57.853774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] MFA Rules not processed for user `716d438ebbcb49069bf9fe416559c846`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:57.871070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:58.104320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:46:58.167755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 858/1721] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:58.194591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:58.195122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:58.195581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:58.237363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] MFA Rules not processed for user `716d438ebbcb49069bf9fe416559c846`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:58.242667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:58.277920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 864/1722] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:58.284361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:58.568596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:58.650792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e56fc0-b3b8-4d01-852e-c883f5fd0f45 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:58.687528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:58.690597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:58.691272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:58.691952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:58.729476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:58.732607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b0582-a398-40ca-ae44-635587bf279f service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:58.789893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 859/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:46:59.024857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f859ccf-f135-4407-9aac-594c79abe234 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:46:59.066062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:46:59.067571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:59.068032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:59.068493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] PATH_INFO: `/v3/users/2268f6a45f854d6293bbe18999432920` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:59.080727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2268f6a45f854d6293bbe18999432920)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:46:59.098689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:46:59.386820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2268f6a45f854d6293bbe18999432920'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:59.421329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2268f6a45f854d6293bbe18999432920'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:59.428875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2268f6a45f854d6293bbe18999432920'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:59.453631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2268f6a45f854d6293bbe18999432920'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:59.500460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2268f6a45f854d6293bbe18999432920'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:46:59.518355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 865/1724] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:46:58 2022] DELETE /identity/v3/users/2268f6a45f854d6293bbe18999432920 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:46:59.526493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a83d-f7dd-4884-8714-ced9d899b9ef None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:46:59.527140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a83d-f7dd-4884-8714-ced9d899b9ef None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:46:59.527944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a83d-f7dd-4884-8714-ced9d899b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:46:59.627269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0c61a83d-f7dd-4884-8714-ced9d899b9ef None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:46:59.633169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0c61a83d-f7dd-4884-8714-ced9d899b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:46:59.935893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 860/1725] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:46:59.976817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:46:59.979419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:00.159764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bffdf-b608-444e-8201-1c7a3f0b493e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:00.178131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:00.178860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.179140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:00.179414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:00.192021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:00.193434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcefa44-e396-4550-8dc9-332f9ed510e9 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:00.238788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 866/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:00.422334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.422824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:00.423309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:00.496099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] MFA Rules not processed for user `832905930aa14f328e0d87f424afbaea`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:00.503701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:00.517426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7212d-7c74-4459-81a1-0067c61f6af8 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.517982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7212d-7c74-4459-81a1-0067c61f6af8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:00.518333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7212d-7c74-4459-81a1-0067c61f6af8 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:00.521329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 867/1727] 10.222.0.48 () {54 vars in 912 bytes} [Tue Jun 28 17:47:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:47:00.538948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad094-635f-47d4-9367-c2774bbc1f43 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.538948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad094-635f-47d4-9367-c2774bbc1f43 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:00.539363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad094-635f-47d4-9367-c2774bbc1f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:00.559090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:00.609219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 861/1728] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:00.621760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f68ad094-635f-47d4-9367-c2774bbc1f43 None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:00.623048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f68ad094-635f-47d4-9367-c2774bbc1f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:00.635983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 868/1729] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:00.926525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:00.942318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:00.952581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df01ec-9821-42a2-94ca-84538b535658 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.952963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df01ec-9821-42a2-94ca-84538b535658 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:00.953311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df01ec-9821-42a2-94ca-84538b535658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:00.976976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb298f15-833a-4d82-be0f-854553b13a8b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:00.991837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:00.993030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:00.996028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:01.001421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:01.023248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:01.024950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435a4b1-e750-402b-9d87-c7ca5cc765cf service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:01.035321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-47df01ec-9821-42a2-94ca-84538b535658 None None] MFA Rules not processed for user `699430b464024375901c098973c4b225`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:01.041345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-47df01ec-9821-42a2-94ca-84538b535658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:01.056227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 862/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:01.297339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 869/1731] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:01.988815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:01.990095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:01.990601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:01.992821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 863/1732] 10.222.0.48 () {54 vars in 912 bytes} [Tue Jun 28 17:47:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:47:02.007620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:02.008306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:02.008751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:02.067422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:02.071165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:02.129795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:02.139435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:02.178976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0531e-9058-48fb-a8cd-0a71397600ca None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:02.181486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 870/1733] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:47:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:02.188402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:02.190574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:02.191351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:02.193115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] PATH_INFO: `/v3/projects/a65fc9ea4d5c4d1ab50875a22f13167e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:02.196343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65fc9ea4d5c4d1ab50875a22f13167e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:02.200150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:02.203530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:02.206323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:02.240062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe86b24-433c-4c4a-a653-5f58ace458b8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:02.272043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:02.274199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:02.274907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:02.276899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:02.324315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:02.327898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:02.377189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 871/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:02.394822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65fc9ea4d5c4d1ab50875a22f13167e', 'request_id': 'req-43d8d121-ac6b-49c2-92f6-dea679daf798'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:02.419628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65fc9ea4d5c4d1ab50875a22f13167e', 'request_id': 'req-43d8d121-ac6b-49c2-92f6-dea679daf798'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:02.462286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65fc9ea4d5c4d1ab50875a22f13167e', 'request_id': 'req-43d8d121-ac6b-49c2-92f6-dea679daf798'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:02.563238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] The token cache is being invalidate because project a65fc9ea4d5c4d1ab50875a22f13167e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:02.563563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:02.565893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-43d8d121-ac6b-49c2-92f6-dea679daf798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:02.578919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 864/1735] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:02 2022] DELETE /identity/v3/projects/a65fc9ea4d5c4d1ab50875a22f13167e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:02.581743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:02.640243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400a7b7-7479-49f9-beff-05ded72b9071 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:03.020645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:03.032434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:03.032979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:03.036497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] PATH_INFO: `/v3/users/5688dcb491e6468ca2951b0e1ede157c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:03.049483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5688dcb491e6468ca2951b0e1ede157c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:03.061437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:03.360838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78bd83-d4a1-47b0-b062-3f0c2104f249 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:03.361545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78bd83-d4a1-47b0-b062-3f0c2104f249 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:03.361756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78bd83-d4a1-47b0-b062-3f0c2104f249 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:03.364592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5688dcb491e6468ca2951b0e1ede157c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:03.365210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 865/1736] 10.222.0.48 () {54 vars in 960 bytes} [Tue Jun 28 17:47:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:47:03.373033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:03.373513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:03.374029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:03.398337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:03.420369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5688dcb491e6468ca2951b0e1ede157c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:03.421407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5688dcb491e6468ca2951b0e1ede157c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:03.449571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5688dcb491e6468ca2951b0e1ede157c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:03.462393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:03.466024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:03.497092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5688dcb491e6468ca2951b0e1ede157c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:03.520402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 872/1737] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:02 2022] DELETE /identity/v3/users/5688dcb491e6468ca2951b0e1ede157c => generated 0 bytes in 940 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:03.813061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 866/1738] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Jun 28 17:47:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:03.821743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:04.121021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b73839-91b2-4c98-b0f4-3ae1cafd6f62 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:04.142190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:04.143015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:04.143305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:04.150230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:04.162310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:04.163599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:04.166450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:04.216208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a3a1d-3213-41b6-b444-f236e87edac8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:04.256664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:04.268346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af6470-cef6-4ae6-82b2-1a082c6e866f service placement] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:04.317361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 873/1739] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:04.529480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:04.539459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:04.540085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:04.542835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] PATH_INFO: `/v3/users/108b956653c84909bc509ab6cd8d8914` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:04.571243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108b956653c84909bc509ab6cd8d8914)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:04.592501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:04.791276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:04.829655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108b956653c84909bc509ab6cd8d8914'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:04.832994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108b956653c84909bc509ab6cd8d8914'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:04.834978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108b956653c84909bc509ab6cd8d8914'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:04.880303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108b956653c84909bc509ab6cd8d8914'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:04.903582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108b956653c84909bc509ab6cd8d8914'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:04.948494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 867/1740] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:04 2022] DELETE /identity/v3/users/108b956653c84909bc509ab6cd8d8914 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:04.956076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a101d2-e81d-4388-b95c-d8e8f2fc9cf3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:04.956365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a101d2-e81d-4388-b95c-d8e8f2fc9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:04.956619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a101d2-e81d-4388-b95c-d8e8f2fc9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:05.008711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-90a101d2-e81d-4388-b95c-d8e8f2fc9cf3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:05.017326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-90a101d2-e81d-4388-b95c-d8e8f2fc9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:05.352849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 874/1741] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:05.498881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:05.500881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:05.638117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c3b9-b890-48b1-bd67-21b8c3702c24 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:05.638652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c3b9-b890-48b1-bd67-21b8c3702c24 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:05.639065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942c3b9-b890-48b1-bd67-21b8c3702c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:05.700642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c942c3b9-b890-48b1-bd67-21b8c3702c24 None None] MFA Rules not processed for user `b8215c04115a40c4b6f8eeebc53206d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:05.702452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c942c3b9-b890-48b1-bd67-21b8c3702c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:05.850340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f8cc9-ddb5-4adf-a7a9-4fa2cc305138 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:05.891683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:05.901023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:05.901682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:05.911507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:05.984256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:05.987564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63a0ac-012c-4f3f-97dc-f1cca809b2d2 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:06.004001 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 875/1742] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:06.007466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:06.011131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:06.011849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:06.032816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 868/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:06.090291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:06.208454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] MFA Rules not processed for user `ad680eeeb787420d9bb421abdb42201a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:06.211735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:06.551953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 876/1744] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 547 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:06.566053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:06.566386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:06.566888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:06.642670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] MFA Rules not processed for user `ad680eeeb787420d9bb421abdb42201a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:06.647627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:06.673840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 869/1745] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:06.855998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:06.858216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:06.913684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4da6f-71cf-419f-b3e8-f97f7d746a80 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:06.934066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:06.935827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:06.936118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:06.936457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] PATH_INFO: `/v3/projects/95127c088f674193aa7223df614e29b5` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:06.941288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95127c088f674193aa7223df614e29b5)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:06.946207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:07.111915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95127c088f674193aa7223df614e29b5', 'request_id': 'req-4873af60-2d2d-461e-933d-20e280f91d60'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.122035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95127c088f674193aa7223df614e29b5', 'request_id': 'req-4873af60-2d2d-461e-933d-20e280f91d60'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.137434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95127c088f674193aa7223df614e29b5', 'request_id': 'req-4873af60-2d2d-461e-933d-20e280f91d60'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.163299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:07.165226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.178164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] The token cache is being invalidate because project 95127c088f674193aa7223df614e29b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:07.178903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.179861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4873af60-2d2d-461e-933d-20e280f91d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.182938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 877/1746] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:06 2022] DELETE /identity/v3/projects/95127c088f674193aa7223df614e29b5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:07.189341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.189702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.190196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.239944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:07.241453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.332512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79420b1d-ec67-4aa8-b884-eaa2ca35c405 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:07.435599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 878/1747] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:07.436694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:07.445019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.468938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92f27f-6392-4288-9d3c-7b82792283f3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:07.479029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:07.480124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.480511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.480907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] PATH_INFO: `/v3/projects/a5964d07db2e473f9be8a0b04182fce5` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.487007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5964d07db2e473f9be8a0b04182fce5)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:07.489215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:07.507929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:07.561790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:07.562540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.562827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.563106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.565123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.591048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:07.675756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5964d07db2e473f9be8a0b04182fce5', 'request_id': 'req-6e3a555e-8390-40ca-8ff9-56f77c382783'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.683706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5964d07db2e473f9be8a0b04182fce5', 'request_id': 'req-6e3a555e-8390-40ca-8ff9-56f77c382783'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.718935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5964d07db2e473f9be8a0b04182fce5', 'request_id': 'req-6e3a555e-8390-40ca-8ff9-56f77c382783'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.739085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] The token cache is being invalidate because project a5964d07db2e473f9be8a0b04182fce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:07.739498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.740401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6e3a555e-8390-40ca-8ff9-56f77c382783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:07.746488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 879/1748] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:07 2022] DELETE /identity/v3/projects/a5964d07db2e473f9be8a0b04182fce5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:07.749137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2916a-9f03-4b85-a55d-1668e2c807a7 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.749839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2916a-9f03-4b85-a55d-1668e2c807a7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.752035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2916a-9f03-4b85-a55d-1668e2c807a7 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.754484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:07.755235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 880/1749] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:47:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:47:07.757070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf87bd-bd23-479a-a027-17677cc50a55 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:07.764895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b724e-58b2-4b71-9253-607a1fbe9dcb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.765345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b724e-58b2-4b71-9253-607a1fbe9dcb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.765798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b724e-58b2-4b71-9253-607a1fbe9dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.788006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 870/1750] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:07.789588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f731-1fd2-483f-b488-609dfe983eaf None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.790260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f731-1fd2-483f-b488-609dfe983eaf None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.792272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899f731-1fd2-483f-b488-609dfe983eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:07.835162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3899f731-1fd2-483f-b488-609dfe983eaf None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:07.840465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3899f731-1fd2-483f-b488-609dfe983eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.914276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-115b724e-58b2-4b71-9253-607a1fbe9dcb None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:07.925708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-115b724e-58b2-4b71-9253-607a1fbe9dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:07.990097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 871/1751] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:07.993289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:07.993584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:07.993868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.030752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:08.034683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:08.138407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 881/1752] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:08.140059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.140431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.140716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.218100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:08.219280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:08.257177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 882/1753] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:08.261089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.267694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 872/1754] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:47:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:08.273997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.294051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84e99-7656-4acb-bf95-ef94feb3020c None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:08.316066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3c8ab-f4c7-441e-b97b-0b33cdf9190d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:08.316826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:08.317583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.318132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.318486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.319265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:08.322154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:08.327364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:08.342120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:08.344613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.346528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.347029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.348983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:08.350423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:08.354634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:08.363941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 883/1755] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:08.365142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.367137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:08.393735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 873/1756] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:08.393735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.400985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:08.401438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f254cb3-4000-459b-b40c-b2d2f66e7809 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:08.417701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:08.418472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.418757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.419034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.422561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7be7a8-fea5-4cee-9b67-507a8785a9b6 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:08.437990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:08.438319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:08.439277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.439635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:08.439938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.440342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.441332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:08.443756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:08.468267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 884/1757] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:08.471325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.501059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c2554-15f4-4962-82cb-196bc51bf08a service placement] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:08.522288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:08.525506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:08.574718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:08.575351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:08.586295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:08.594201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:08.613391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 874/1758] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:08 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:08.617928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.773166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 885/1759] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:08 2022] POST /identity/v3/projects => generated 367 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:08.778805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:08.969845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd3ac-4e03-4af1-8158-9a00f54e8ed3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.256351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.258443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:09.263006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.263611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.267072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.268792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.270956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.347792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 875/1760] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:08 2022] POST /identity/v3/users => generated 282 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:09.350272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:09.356196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed849-984d-46c0-8ace-3568760edb34 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.374573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f559c4-3ad5-4a54-b911-5ab2a9e9a462 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.381726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.382969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.383423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.387107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.388371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.392500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.393268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.393566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.393880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.394729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.396201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.396622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.420128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 876/1761] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:09.425866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:09.448981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65fe9a-511a-4422-bddf-3781a795ff2a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.456941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.457710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.458019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.460466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.461419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.464193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.480226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 877/1762] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:09.486373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 886/1763] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:08 2022] POST /identity/v3/users => generated 284 bytes in 711 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:09.488288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:09.492995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:09.504822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaaca5-9afb-4853-9a4b-a0f2ae8be86f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.515365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.516731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.517035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.522122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] PATH_INFO: `/v3/projects/7bcc55c75cd64438be3f5728e27ab6f4/users/af2aa4aba09d493cacaf75221d5428ff/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.543024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176eb26-c5e2-47fb-bac4-d9104173683c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.564182 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:09.565274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.566055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.566536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.567927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.581372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.591295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bcc55c75cd64438be3f5728e27ab6f4, user_id=af2aa4aba09d493cacaf75221d5428ff, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:09.614403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f7441-c535-4327-bad2-0538fd8a8714 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:09.629136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 887/1764] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:09.632867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:09.678364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccbe7e-e7d1-4692-a1a8-9635742058fe admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:09.679347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 878/1765] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:09 2022] PUT /identity/v3/projects/7bcc55c75cd64438be3f5728e27ab6f4/users/af2aa4aba09d493cacaf75221d5428ff/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:09.681877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789db-0553-4219-9d37-9ff93a4ecc2b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:09.684784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789db-0553-4219-9d37-9ff93a4ecc2b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:09.685215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f789db-0553-4219-9d37-9ff93a4ecc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:09.784241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-01f789db-0553-4219-9d37-9ff93a4ecc2b None None] MFA Rules not processed for user `af2aa4aba09d493cacaf75221d5428ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:09.789460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-01f789db-0553-4219-9d37-9ff93a4ecc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:09.849751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:10.111996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:10.113153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.113507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.113833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.116801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:10.119315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:10.163489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 879/1766] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:10.166259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.167077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.167610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.195224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 888/1767] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:10.201042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:10.229758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:10.232364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:10.262821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed31d9b-bc89-42dc-9dcc-91f6ef64bd07 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:10.287318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:10.288808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.289272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.289718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.291131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:10.300099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:10.417232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 889/1768] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:10 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:10.418787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:10.664429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 880/1769] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:47:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:10.679915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:10.760002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08882f0e-604d-438e-a0ed-ffd7c5738267 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:10.788746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0d93c-5864-44b1-b830-8fc1109bdb56 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:10.790253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:10.791735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.792439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.793191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.797275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:10.802940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:10.828588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:10.836461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.839618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.840170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] PATH_INFO: `/v3/projects/0941cb9fac2b48139803449537b0caf6/users/39376aab8d044122846a32b86c5bc6da/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.849493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 881/1770] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:10 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:10.854900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:10.884963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944000b-2a5f-4792-9729-8cab471aca0a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:10.896568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:10.898927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:10.900435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:10.901755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:10.904612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:10.914762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:10.945394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 882/1771] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:10.947876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:10.948972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0941cb9fac2b48139803449537b0caf6, user_id=39376aab8d044122846a32b86c5bc6da, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:10.974935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de345b9b-2756-457c-a36c-a112c003ff4f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:10.980596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:10.994426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:11.000763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:11.004357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:11.005434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] PATH_INFO: `/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a/users/87828ec45ac5464d9045ab4882c9262a/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:11.028532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 890/1772] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:10 2022] PUT /identity/v3/projects/0941cb9fac2b48139803449537b0caf6/users/39376aab8d044122846a32b86c5bc6da/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:11.030487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:11.047680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:11.128147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eefc2b44c4502ac34d226d72c1e8a, user_id=87828ec45ac5464d9045ab4882c9262a, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:11.133046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c67580-47ff-4855-af3e-33da0362d01b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:11.183795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 883/1773] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:10 2022] PUT /identity/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a/users/87828ec45ac5464d9045ab4882c9262a/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:11.191545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:11.192010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:11.192481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:11.196612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:11.340196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] MFA Rules not processed for user `39376aab8d044122846a32b86c5bc6da`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:11.342646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:11.390581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e11f-976e-42ca-8a39-fce42f3ae12d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:11.645681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:11.646901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:11.647374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:11.648401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:11.710136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 884/1774] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:11.715473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:11.721717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:11.755689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:11.932288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:11.939187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:12.003251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 891/1775] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:47:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 974 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:47:12.007964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:12.069326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245446d-2d26-449b-84a6-6ae7230b14ef service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:12.111222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7bbd1-c405-4695-b615-cfb4ca7f9b94 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:12.122612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:12.125065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:12.126238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:12.127200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:12.137573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:12.137573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:12.205021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 892/1776] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:12.208466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:12.214314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:12.249115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:12.249538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:12.249828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] PATH_INFO: `/v3/users/fcca6dff4370492f8af122b3f3a4e54d` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:12.256043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e97d-94ed-4958-8833-5709c1decf63 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:12.268778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:12.271333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:12.277155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:12.278800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:12.279832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:12.283205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cd571-1fcc-4763-bc19-c65c8783afb4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:12.316058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcca6dff4370492f8af122b3f3a4e54d)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:12.352287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:12.390658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 893/1777] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:12 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:12.392474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:12.397318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:12.406341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:12.465582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] MFA Rules not processed for user `ad680eeeb787420d9bb421abdb42201a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:12.476665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:12.589466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcca6dff4370492f8af122b3f3a4e54d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:12.592315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcca6dff4370492f8af122b3f3a4e54d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:12.593522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcca6dff4370492f8af122b3f3a4e54d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:12.610900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:12.629452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcca6dff4370492f8af122b3f3a4e54d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:12.654891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcca6dff4370492f8af122b3f3a4e54d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:12.680440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 894/1778] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:12.686283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:12.694947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:12.737411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 885/1779] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:11 2022] DELETE /identity/v3/users/fcca6dff4370492f8af122b3f3a4e54d => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:12.739035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:12.742019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:12.936867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08c1d-76db-427f-b55c-903b37fe7374 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:13.074367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdf67-0d2a-43fa-865b-23053753b35b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:13.122542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:13.130679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:13.150368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:13.154199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:13.189148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:13.192267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:13.193905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:13.194336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:13.194621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] PATH_INFO: `/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a/users/87828ec45ac5464d9045ab4882c9262a/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:13.197436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2eefc2b44c4502ac34d226d72c1e8a, user_id=87828ec45ac5464d9045ab4882c9262a, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:13.207947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e66a2b-925d-4162-a26d-27d84e87c6c5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:13.215808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:13.261459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 895/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:12 2022] PUT /identity/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a/users/87828ec45ac5464d9045ab4882c9262a/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:13.287780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:13.288129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:13.288394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:13.396105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 886/1781] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:12 2022] POST /identity/v3/users => generated 291 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:13.399621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:13.447546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] MFA Rules not processed for user `87828ec45ac5464d9045ab4882c9262a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:13.449543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:13.533907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182ad4a-94b0-4e97-830c-b5b8e1052e5a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:13.595080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:13.776554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:13.779281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:13.779742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:13.780037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:13.784086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:13.787637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:13.826046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 887/1782] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:13.827099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:13.884689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7ac0-5e69-4a4d-b17d-e3424fd6dce6 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:13.901574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:13.905904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:13.907234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:13.909768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] PATH_INFO: `/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b/users/e34639369bc8459a8a9f06a1c7ee87bf/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:13.968403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff929d8fc9ec4879ad14ae283cb2fe2b, user_id=e34639369bc8459a8a9f06a1c7ee87bf, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:13.977986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:13.999982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 896/1783] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 710 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:14.014307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:14.015838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:14.023837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 888/1784] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:13 2022] PUT /identity/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b/users/e34639369bc8459a8a9f06a1c7ee87bf/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:14.025075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:14.065280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:14.227855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bf7bc-8cd1-4ef6-b44a-6c733c8b7ace admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:14.253014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d0732-a948-46cb-aec9-1b9d15b3d068 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:14.254798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:14.256079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:14.256776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:14.256776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:14.257808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:14.266917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:14.302398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 889/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:14.314391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:14.361042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774f361-7c68-4c50-a778-67b9f58f2404 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:14.441581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:14.446583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:14.447136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:14.450293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] PATH_INFO: `/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b/users/e34639369bc8459a8a9f06a1c7ee87bf/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:14.461485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff929d8fc9ec4879ad14ae283cb2fe2b, user_id=e34639369bc8459a8a9f06a1c7ee87bf, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:14.487465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef66b8b-6fe1-46b8-8372-969b61c66de2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:14.544503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:14.548066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:14.559504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 890/1786] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:14 2022] PUT /identity/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b/users/e34639369bc8459a8a9f06a1c7ee87bf/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:14.560406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:14.560761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:14.564728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bad-4aaa-4387-a979-fd402b6d0027 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:14.569635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bad-4aaa-4387-a979-fd402b6d0027 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:14.572508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d809bad-4aaa-4387-a979-fd402b6d0027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:14.670181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9d809bad-4aaa-4387-a979-fd402b6d0027 None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:14.671458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9d809bad-4aaa-4387-a979-fd402b6d0027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:14.871490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 891/1787] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jun 28 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:14.873046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:14.881894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:14.882710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:14.884015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:14.885297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:14.923213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 897/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 909 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:14.987377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] MFA Rules not processed for user `e34639369bc8459a8a9f06a1c7ee87bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:14.990411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:15.011976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:15.155112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:15.201439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd77a28-8313-46ae-8e9a-937c4afe8f66 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:15.359023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:15.360277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:15.360810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:15.361358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:15.380567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:15.544616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:15.650126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:15.662554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:15.708507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 898/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:15.709538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:15.714716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:15.717981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 892/1790] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 843 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:15.746721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f16bd-34a9-405b-8353-737403dc3325 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:15.759824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:15.762364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:15.769814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:15.770536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:15.770769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:15.771050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:15.797277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:15.803289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:15.824201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 899/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:15.825095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:15.830708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:15.866456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29121b-70a0-47e6-bf45-05c3d8ec6686 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:15.877808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:15.881347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:15.881829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:15.885251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:15.908777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:15.916488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46b29-7e1a-48df-b88a-0d2806ddbbce service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:15.966777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 900/1792] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:15 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:16.088271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c660bc-7782-461f-b36d-9be3d67a04a8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:16.111320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:16.112239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:16.112527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:16.112798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] PATH_INFO: `/v3/users/4edb203e031f4374a5b38b7217b2c05b` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:16.119711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edb203e031f4374a5b38b7217b2c05b)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:16.127173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:16.350659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edb203e031f4374a5b38b7217b2c05b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:16.351498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edb203e031f4374a5b38b7217b2c05b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:16.352656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edb203e031f4374a5b38b7217b2c05b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:16.370924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edb203e031f4374a5b38b7217b2c05b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:16.389458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edb203e031f4374a5b38b7217b2c05b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:16.445618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 893/1793] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:15 2022] DELETE /identity/v3/users/4edb203e031f4374a5b38b7217b2c05b => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:16.447645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:16.448195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:16.448195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:16.537434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:16.539218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:16.811905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 901/1794] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:17.326736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:17.326736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:17.387661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:17.540148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8386db-0a64-4988-ab23-e187ca5e1492 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:17.557399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:17.558133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:17.558424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:17.558705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:17.583986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:17.585571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:17.607768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 894/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:17.642958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:17.647334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:17.754862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105adb-ece8-43a2-9630-1d0be250805f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:17.811062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:17.818972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:17.819313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:17.819594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] PATH_INFO: `/v3/projects/e7b63f4253b746caa7f567dac98cfbf2` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:17.839101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b63f4253b746caa7f567dac98cfbf2)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:17.841646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:18.170747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b63f4253b746caa7f567dac98cfbf2', 'request_id': 'req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.198112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b63f4253b746caa7f567dac98cfbf2', 'request_id': 'req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.206925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b63f4253b746caa7f567dac98cfbf2', 'request_id': 'req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.250027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] The token cache is being invalidate because project e7b63f4253b746caa7f567dac98cfbf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:18.250866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.260016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.264643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 902/1796] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:17 2022] DELETE /identity/v3/projects/e7b63f4253b746caa7f567dac98cfbf2 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:18.269909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:18.290055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8211504-df5d-4ec3-b660-f418a1306680 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:18.543513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:18.544473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:18.544800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:18.545035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] PATH_INFO: `/v3/users/699430b464024375901c098973c4b225` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:18.560262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=699430b464024375901c098973c4b225)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:18.574923 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:18.751757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699430b464024375901c098973c4b225'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.751757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699430b464024375901c098973c4b225'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.751757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699430b464024375901c098973c4b225'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.793828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699430b464024375901c098973c4b225'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.824901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4280630d-313a-4ca9-8b0c-f4b96c8ffeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699430b464024375901c098973c4b225'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:18.907765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 895/1797] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:18 2022] DELETE /identity/v3/users/699430b464024375901c098973c4b225 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:20.085517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:20.088045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:20.111736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a590f-2e02-47f5-82c6-05fbfa5ede65 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:20.223812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:20.333596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:20.337253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:20.337970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:20.338428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] PATH_INFO: `/v3/users/39376aab8d044122846a32b86c5bc6da` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:20.340127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39376aab8d044122846a32b86c5bc6da)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:20.342850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:20.564172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39376aab8d044122846a32b86c5bc6da'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:20.593756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39376aab8d044122846a32b86c5bc6da'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:20.595423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39376aab8d044122846a32b86c5bc6da'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:20.616305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39376aab8d044122846a32b86c5bc6da'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:20.649662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39376aab8d044122846a32b86c5bc6da'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:20.669060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 903/1798] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:20 2022] DELETE /identity/v3/users/39376aab8d044122846a32b86c5bc6da => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:20.680597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:20.681324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:20.683656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:20.771547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:20.778118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:20.875106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:20.907502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 896/1799] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:20.961998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:20.965159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:21.081016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bced7-55ff-47cb-a235-5d754f3a7db0 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:21.094161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:21.095338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.097513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.099480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:21.131761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:21.137484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c601b5c-3158-4143-ad5f-7df97dc27394 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:21.197985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 904/1800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:21.371892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:21.373498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:21.387950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfec19e-51bb-483c-ad03-1a0bf324379d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:21.402118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:21.403806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.404541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.405206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] PATH_INFO: `/v3/projects/a7d0078a2db04d749b29db8ed3b72158` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:21.410949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d0078a2db04d749b29db8ed3b72158)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:21.413166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:21.514497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d0078a2db04d749b29db8ed3b72158', 'request_id': 'req-d1ad6581-5a63-43a6-be31-c722be8ff18e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:21.523161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d0078a2db04d749b29db8ed3b72158', 'request_id': 'req-d1ad6581-5a63-43a6-be31-c722be8ff18e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:21.532184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d0078a2db04d749b29db8ed3b72158', 'request_id': 'req-d1ad6581-5a63-43a6-be31-c722be8ff18e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:21.575656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] The token cache is being invalidate because project a7d0078a2db04d749b29db8ed3b72158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:21.576123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:21.577621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d1ad6581-5a63-43a6-be31-c722be8ff18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:21.581753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 897/1801] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:21 2022] DELETE /identity/v3/projects/a7d0078a2db04d749b29db8ed3b72158 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:21.588372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b929c6-6549-4b11-9070-5ff4ea2b150c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.589258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b929c6-6549-4b11-9070-5ff4ea2b150c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.592968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b929c6-6549-4b11-9070-5ff4ea2b150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:21.675654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a5b929c6-6549-4b11-9070-5ff4ea2b150c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:21.696145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a5b929c6-6549-4b11-9070-5ff4ea2b150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:21.904998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514098-8dbd-4b35-9247-7677c26f9225 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.905583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514098-8dbd-4b35-9247-7677c26f9225 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.905583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11514098-8dbd-4b35-9247-7677c26f9225 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:21.907972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 898/1802] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:47:21.925494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:21.940453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b630-db1b-490f-a5cf-499f457e040c None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.940978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b630-db1b-490f-a5cf-499f457e040c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.941391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6b630-db1b-490f-a5cf-499f457e040c None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:21.943283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 899/1803] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:47:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:47:21.983132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 905/1804] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:21.991464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:21.991814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:21.992000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.024383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:22.024816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:22.026679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.082135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:22.082135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:22.137098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:22.146623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:22.150050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 900/1805] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:22.158928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:22.190586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06177ffa-7ab9-4ec4-aa48-f7e8ccb969ac None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:22.210315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:22.211019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:22.211378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:22.211685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.216753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:22.218085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:22.228700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fe937-0caf-4db0-b97b-703b63ccdd80 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:22.294582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 901/1806] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:22.294582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:22.294582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:22.294582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.405412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:22.417781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:22.434493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 906/1807] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:22.435922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:22.482951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 902/1808] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:47:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:22.491226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06915-5d06-4f29-9e0f-2f40f71c53c5 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:22.518432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:22.520655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:22.522600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:22.523752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.527668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:22.530983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:22.646489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 907/1809] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:22 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:22.652625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:22.678819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218623a7-d92b-41f9-a321-0309ffbb6e7e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:22.830643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:22.832918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:22.930257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:22.932991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:22.933785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:22.935079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:22.936989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:22.942908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.007108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 903/1810] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:22 2022] POST /identity/v3/users => generated 286 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:23.018460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:23.059720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4144-daca-410e-9bfe-213c97c6851a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:23.085119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:23.086356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.086825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.087545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:23.088523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:23.092940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.155772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea701a-7d0e-410a-a1fb-94fc9ab318b2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:23.162228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 904/1811] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:23.164418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:23.173292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:23.174469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.174772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.175029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] PATH_INFO: `/v3/projects/44427c1ac66b470fbbadbf5ebbeccd4d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:23.177725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=44427c1ac66b470fbbadbf5ebbeccd4d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:23.182971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.228430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43721e71-2ac7-4e6e-ab78-d8548a0b4ca3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:23.271311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:23.272771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.273707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.274029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:23.284999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:23.295046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.345446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44427c1ac66b470fbbadbf5ebbeccd4d', 'request_id': 'req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:23.355023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44427c1ac66b470fbbadbf5ebbeccd4d', 'request_id': 'req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:23.356374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:23.369145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44427c1ac66b470fbbadbf5ebbeccd4d', 'request_id': 'req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:23.383736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 905/1812] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:23.387932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:23.401570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] The token cache is being invalidate because project 44427c1ac66b470fbbadbf5ebbeccd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:23.402022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:23.404169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:23.413444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 908/1813] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:22 2022] DELETE /identity/v3/projects/44427c1ac66b470fbbadbf5ebbeccd4d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:23.414877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:23.419267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:23.428554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c955455-1acc-4cfc-bc44-734b323257aa admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:23.456240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:23.689989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc40a-c260-48dd-8fd7-1d1b0dcf3bbf admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:23.711352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:23.715143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.715666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.716094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] PATH_INFO: `/v3/users/fb4aeb8e79e3466999ecc26e6e886852` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:23.729219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4aeb8e79e3466999ecc26e6e886852)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:23.750350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.770099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:23.783575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.790622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.792069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] PATH_INFO: `/v3/projects/9224ccf6de9d4a94a55b413b21417f23/users/52cc1843347645b6a7a37fcc2fcd6c1f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:23.860885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9224ccf6de9d4a94a55b413b21417f23, user_id=52cc1843347645b6a7a37fcc2fcd6c1f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:23.867321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d01c4-9e9c-480c-a79f-4778d548e4d9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:23.931374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 906/1814] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:23 2022] PUT /identity/v3/projects/9224ccf6de9d4a94a55b413b21417f23/users/52cc1843347645b6a7a37fcc2fcd6c1f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:23.940861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:23.942283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:23.943282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:24.007495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4aeb8e79e3466999ecc26e6e886852'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:24.058926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] MFA Rules not processed for user `52cc1843347645b6a7a37fcc2fcd6c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:24.063348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4aeb8e79e3466999ecc26e6e886852'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:24.064568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4aeb8e79e3466999ecc26e6e886852'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:24.065806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:24.104282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4aeb8e79e3466999ecc26e6e886852'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:24.203341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4aeb8e79e3466999ecc26e6e886852'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:24.221062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 909/1815] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:23 2022] DELETE /identity/v3/users/fb4aeb8e79e3466999ecc26e6e886852 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:24.263266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 907/1816] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:24.265105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:24.268181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:24.363971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:24.365693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:24.636970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7d8c0-26a7-4ad2-9627-a5c0f621583b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:24.646167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3cce5-3c05-463d-98fc-b12962b4c6c9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:24.658319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:24.659346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:24.659775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:24.660190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:24.661044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:24.663244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:24.691286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:24.726431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:24.793371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 910/1817] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:24 2022] POST /identity/v3/projects => generated 373 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:24.796421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:24.799800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:24.881173 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:24.882659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:24.884413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:24.885053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:24.891839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:24.933335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:24.940561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:24.982933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 908/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:24.984359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.014781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425d09a-5de8-497b-a4da-40ca37f3e4f2 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.049632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df47a8-3b4e-4b4e-b815-05b18aa71548 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.058273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.060877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.061406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.062088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.068326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:25.095242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.098831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.118425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 911/1819] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:25.192175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.192827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.193118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.193434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.195761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.198142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.209512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.212204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:25.258247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f994d58-1d28-4568-b3cf-2c752254796d service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.265569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 909/1820] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:24 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:25.269396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.275249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.277785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.278114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.278447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] PATH_INFO: `/v3/projects/0941cb9fac2b48139803449537b0caf6` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.282711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0941cb9fac2b48139803449537b0caf6)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.285273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.293013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd39fb-da8e-46c3-ba98-08f6492cfa7e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.306464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.307308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.307848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.308138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.308942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.311042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.354695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 910/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:25.355896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.405911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f570c-20c2-4c2b-a100-e086ba23732a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.499516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0941cb9fac2b48139803449537b0caf6', 'request_id': 'req-77e596d8-498d-40c3-9072-e13ffd76841e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:25.572113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0941cb9fac2b48139803449537b0caf6', 'request_id': 'req-77e596d8-498d-40c3-9072-e13ffd76841e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:25.615488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0941cb9fac2b48139803449537b0caf6', 'request_id': 'req-77e596d8-498d-40c3-9072-e13ffd76841e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:25.702090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.713103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] The token cache is being invalidate because project 0941cb9fac2b48139803449537b0caf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:25.713103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:25.719315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.720951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:25.721447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.721775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] PATH_INFO: `/v3/projects/5fda2309457e48b8b8685d842d2063a7/users/f00ea5c318404ee6b54e2cbc34e635b8/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.724759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 912/1822] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:25 2022] DELETE /identity/v3/projects/0941cb9fac2b48139803449537b0caf6 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:25.729463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.732141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:25.796619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e596d8-498d-40c3-9072-e13ffd76841e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:25.812275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fda2309457e48b8b8685d842d2063a7, user_id=f00ea5c318404ee6b54e2cbc34e635b8, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.820988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:25.822881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:25.823217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:25.825001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.826174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] PATH_INFO: `/v3/users/e34639369bc8459a8a9f06a1c7ee87bf` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:25.835962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34639369bc8459a8a9f06a1c7ee87bf)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:25.842366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:25.912668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 911/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:25 2022] PUT /identity/v3/projects/5fda2309457e48b8b8685d842d2063a7/users/f00ea5c318404ee6b54e2cbc34e635b8/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:25.920498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:25.929536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:25.966519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:26.073750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34639369bc8459a8a9f06a1c7ee87bf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:26.100149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:26.103641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34639369bc8459a8a9f06a1c7ee87bf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:26.104586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34639369bc8459a8a9f06a1c7ee87bf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:26.127128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34639369bc8459a8a9f06a1c7ee87bf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:26.170838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34639369bc8459a8a9f06a1c7ee87bf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:26.194030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 913/1824] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:25 2022] DELETE /identity/v3/users/e34639369bc8459a8a9f06a1c7ee87bf => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:26.240854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110dfd-9bd8-4b2f-9209-f41f3b19dc4f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:26.419907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:26.421059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:26.421616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:26.422333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:26.423367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:26.425608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd117f-bb00-450f-ac6f-20e32610e5cf admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:26.461545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 912/1825] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:26.468055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:26.470388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:26.500116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410148-c348-482e-8148-92b54dd16708 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:26.511135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:26.512431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:26.512605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:26.512867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] PATH_INFO: `/v3/projects/5fda2309457e48b8b8685d842d2063a7/users/f00ea5c318404ee6b54e2cbc34e635b8/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:26.519383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fda2309457e48b8b8685d842d2063a7, user_id=f00ea5c318404ee6b54e2cbc34e635b8, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:26.522913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:26.553470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 914/1826] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:26 2022] PUT /identity/v3/projects/5fda2309457e48b8b8685d842d2063a7/users/f00ea5c318404ee6b54e2cbc34e635b8/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:26.567588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:26.568014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:26.568299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:26.698288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] MFA Rules not processed for user `f00ea5c318404ee6b54e2cbc34e635b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:26.700513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:26.915338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 913/1827] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:26.936881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:26.938971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:27.064434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:27.066467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:27.154830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7452b-410b-497b-8c92-082da7027ca5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:27.171241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:27.176704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:27.177183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:27.177427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:27.203969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:27.258939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:27.262097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c91aa5-0e2d-4938-8af2-0cac7a4b3c64 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:27.303735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22dc52-4722-413a-b769-beb8fc89adc8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:27.318776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:27.319810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:27.320156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:27.320453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] PATH_INFO: `/v3/users/af2aa4aba09d493cacaf75221d5428ff` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:27.327258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2aa4aba09d493cacaf75221d5428ff)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:27.335546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:27.381560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 915/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:27.471190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2aa4aba09d493cacaf75221d5428ff'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:27.472504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2aa4aba09d493cacaf75221d5428ff'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:27.475036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2aa4aba09d493cacaf75221d5428ff'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:27.512394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2aa4aba09d493cacaf75221d5428ff'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:27.543284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2aa4aba09d493cacaf75221d5428ff'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:27.610235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 914/1829] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:27 2022] DELETE /identity/v3/users/af2aa4aba09d493cacaf75221d5428ff => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:27.620947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:27.641341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:27.645764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:27.815199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:27.826006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.073535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 916/1830] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:28.112199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:28.115554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.401858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c7420-6847-4f63-9295-8f0ec3d3d301 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:28.414129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:28.415993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:28.415993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:28.416467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:28.441285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:28.442834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.466070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:28.467531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d215874-80c5-4600-8b2c-912de1afcced None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:28.468257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f341f-be61-4354-abfe-d681896fa6dd service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:28.477385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:28.478608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:28.478908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:28.479346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] PATH_INFO: `/v3/users/52cc1843347645b6a7a37fcc2fcd6c1f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:28.481348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cc1843347645b6a7a37fcc2fcd6c1f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:28.484981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:28.492449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 915/1831] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:28.624125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cc1843347645b6a7a37fcc2fcd6c1f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:28.650172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cc1843347645b6a7a37fcc2fcd6c1f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:28.654249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cc1843347645b6a7a37fcc2fcd6c1f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:28.656532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:28.678292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cc1843347645b6a7a37fcc2fcd6c1f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:28.720657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cc1843347645b6a7a37fcc2fcd6c1f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:28.747788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 917/1832] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:28 2022] DELETE /identity/v3/users/52cc1843347645b6a7a37fcc2fcd6c1f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:28.748266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:28.748647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:28.748903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:28.800017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:28.800679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.917416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:28.950263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 916/1833] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:28.965582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:28.967460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.982358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:28.988742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:28.991794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3680c-2a32-4a90-86a6-f9bbbd8058b6 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:28.998254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.000270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.002118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.003005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] PATH_INFO: `/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.004494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff929d8fc9ec4879ad14ae283cb2fe2b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.007494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.035020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d1e59-bc29-436f-98c6-bf890e4e25a3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.051757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.054359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.054666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.056844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] PATH_INFO: `/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.059068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fa2d0a96484f2a9e8f07e8c5affd03)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.064748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.139673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fa2d0a96484f2a9e8f07e8c5affd03', 'request_id': 'req-3446f0a1-7f80-4932-8cf7-6749d365c692'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.144346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff929d8fc9ec4879ad14ae283cb2fe2b', 'request_id': 'req-395bb67c-7b7d-42bd-9097-5ef80a744880'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.147517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fa2d0a96484f2a9e8f07e8c5affd03', 'request_id': 'req-3446f0a1-7f80-4932-8cf7-6749d365c692'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.155448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fa2d0a96484f2a9e8f07e8c5affd03', 'request_id': 'req-3446f0a1-7f80-4932-8cf7-6749d365c692'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.156750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff929d8fc9ec4879ad14ae283cb2fe2b', 'request_id': 'req-395bb67c-7b7d-42bd-9097-5ef80a744880'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.178301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff929d8fc9ec4879ad14ae283cb2fe2b', 'request_id': 'req-395bb67c-7b7d-42bd-9097-5ef80a744880'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.180439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] The token cache is being invalidate because project 18fa2d0a96484f2a9e8f07e8c5affd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:29.180873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.182700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.189382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 917/1834] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:28 2022] DELETE /identity/v3/projects/18fa2d0a96484f2a9e8f07e8c5affd03 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:29.190762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.192778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.195943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] The token cache is being invalidate because project ff929d8fc9ec4879ad14ae283cb2fe2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:29.196455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.197235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-395bb67c-7b7d-42bd-9097-5ef80a744880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:29.199427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 918/1835] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:28 2022] DELETE /identity/v3/projects/ff929d8fc9ec4879ad14ae283cb2fe2b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:29.200916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30376-3a78-43fc-944d-0877945104d0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.201346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30376-3a78-43fc-944d-0877945104d0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.201724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e30376-3a78-43fc-944d-0877945104d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.225067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d2e30376-3a78-43fc-944d-0877945104d0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:29.226555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d2e30376-3a78-43fc-944d-0877945104d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.307849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 919/1836] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:29.309602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45bf8-75dc-4db7-919e-5a903ce56971 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.310096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45bf8-75dc-4db7-919e-5a903ce56971 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.310636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d45bf8-75dc-4db7-919e-5a903ce56971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.322760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446f0a1-7f80-4932-8cf7-6749d365c692 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.329316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.330208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.330610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.331128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.333604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.344077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-86d45bf8-75dc-4db7-919e-5a903ce56971 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:29.345086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-86d45bf8-75dc-4db7-919e-5a903ce56971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.349614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.351572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f05bf-7530-48d0-a2b3-c170eb9ab02c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.357675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 920/1837] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:29.363688 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.364805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.364805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.367908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 918/1838] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:29.369999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.370368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.370720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.393392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:29.393672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:29.394863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.394992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.411889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 919/1839] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:29.415363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.418901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 921/1840] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:29.424160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.429088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e378f-d502-492e-99c2-4a0f37a9349b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.439786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.443586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.444323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.444990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.447312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:29.448232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.449433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8cb2f-2a86-4f93-a345-0b1bfd6295e4 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.452131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.463794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.465271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.465553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.465828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.466645 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:29.466939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.472284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.476955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 920/1841] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:47:29.483234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.500387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8a74-c3dd-4b4e-b3bd-eb55d0593fd2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.503459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 922/1842] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:29.508454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.519471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.519471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.519471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.519471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.520177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.525860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.536018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d563517-f164-4d0e-b968-d8d4beed4da8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.563342 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.564795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.565985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.566662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.573300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.578947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.583349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 921/1843] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:29.586668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.688612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 923/1844] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:29.691565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:29.698195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:29.715466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:29.732537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:29.762999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd72ce-3892-4687-b0b0-5bbfeec64653 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.856170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732e1ff-ec0b-4a23-976a-d8c184faa3be admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:29.866991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.870307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.871409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.872951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] PATH_INFO: `/v3/projects/7bcc55c75cd64438be3f5728e27ab6f4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.876632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bcc55c75cd64438be3f5728e27ab6f4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.878737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.902847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:29.903441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:29.903727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:29.903999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:29.904711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:29.909028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:29.955347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 922/1845] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/users => generated 287 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:29.957974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.016304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1751290-4aef-4381-801e-9a19229dffbb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.028306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bcc55c75cd64438be3f5728e27ab6f4', 'request_id': 'req-de1be637-a13a-4156-bcdb-f9c9f0169a7c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.042525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bcc55c75cd64438be3f5728e27ab6f4', 'request_id': 'req-de1be637-a13a-4156-bcdb-f9c9f0169a7c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.057823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bcc55c75cd64438be3f5728e27ab6f4', 'request_id': 'req-de1be637-a13a-4156-bcdb-f9c9f0169a7c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.082813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] The token cache is being invalidate because project 7bcc55c75cd64438be3f5728e27ab6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:30.083362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.086083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.089608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 924/1846] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:29 2022] DELETE /identity/v3/projects/7bcc55c75cd64438be3f5728e27ab6f4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:30.096387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.098945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.151803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.154184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.154658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.155275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.156807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.160344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.217192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 923/1847] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:29 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:30.218288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.225782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.255864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40c244-d5c1-4de7-b7fa-92e64a8c6b7e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.265986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.267517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.268021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.268505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] PATH_INFO: `/v3/users/87828ec45ac5464d9045ab4882c9262a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.278963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1be637-a13a-4156-bcdb-f9c9f0169a7c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.280711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87828ec45ac5464d9045ab4882c9262a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.285086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.296872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.297598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.297886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.298246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.299031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.302405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.319472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 925/1848] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:30.320840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.324514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.339667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a34f43-8a85-492b-8fc3-3957e0615f5a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.346157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.347007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.347527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.347881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.348655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.350756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.368826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 926/1849] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:30.369568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.392864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ec56a-11b6-4990-b8bf-c51b9cbe2ae5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.412955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.414896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.415478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.415824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.416856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.418625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.436962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 927/1850] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:30.437979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.450516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c2f4-ae86-4fd2-84b9-4fe31787880d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.453722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87828ec45ac5464d9045ab4882c9262a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.455070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87828ec45ac5464d9045ab4882c9262a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.455954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87828ec45ac5464d9045ab4882c9262a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.468574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.469325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.469693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.470079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.471707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87828ec45ac5464d9045ab4882c9262a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.473692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.475397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.482593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:DELETE=8 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:30.494389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 928/1851] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:30.496138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.497628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87828ec45ac5464d9045ab4882c9262a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.498487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.508676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:30.517297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0da627-66a4-45e7-bf71-5e95803b7ec5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.528689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.529905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.531285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.531285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] PATH_INFO: `/v3/projects/9224ccf6de9d4a94a55b413b21417f23` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.533360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9224ccf6de9d4a94a55b413b21417f23)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.536030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.543093 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 924/1852] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:30 2022] DELETE /identity/v3/users/87828ec45ac5464d9045ab4882c9262a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:30.544423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.546700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.609879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9224ccf6de9d4a94a55b413b21417f23', 'request_id': 'req-2be8c802-66cb-4bad-8c50-6355f204bdb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.632780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9224ccf6de9d4a94a55b413b21417f23', 'request_id': 'req-2be8c802-66cb-4bad-8c50-6355f204bdb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.649858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9224ccf6de9d4a94a55b413b21417f23', 'request_id': 'req-2be8c802-66cb-4bad-8c50-6355f204bdb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.674253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] The token cache is being invalidate because project 9224ccf6de9d4a94a55b413b21417f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:30.674724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.675710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:30.678754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 929/1853] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:30 2022] DELETE /identity/v3/projects/9224ccf6de9d4a94a55b413b21417f23 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:30.679569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.681457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.725680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87699988-d778-4d68-bc36-e272d21f1281 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.831302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8c802-66cb-4bad-8c50-6355f204bdb2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:30.849679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.850735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.851052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.851548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] PATH_INFO: `/v3/projects/5ead242984a14ce6b46c46a2679925ce/users/dc9fe5a5f3564523b429cc71ab3eaa3f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.883187 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:30.884893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.885439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.885993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] PATH_INFO: `/v3/projects/4f1a9871fcd4412480c47fefe125b8b2/users/f01938ff60c54cf98125dec5bfce1f48/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:30.887737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ead242984a14ce6b46c46a2679925ce, user_id=dc9fe5a5f3564523b429cc71ab3eaa3f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.898747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.911487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1a9871fcd4412480c47fefe125b8b2, user_id=f01938ff60c54cf98125dec5bfce1f48, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:30.914675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8df39a-8e51-4025-9dbe-e80ae09606ad admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:30.941324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 930/1854] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:30 2022] PUT /identity/v3/projects/5ead242984a14ce6b46c46a2679925ce/users/dc9fe5a5f3564523b429cc71ab3eaa3f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:30.943086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:30.956294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:30.981671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 925/1855] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:30 2022] PUT /identity/v3/projects/4f1a9871fcd4412480c47fefe125b8b2/users/f01938ff60c54cf98125dec5bfce1f48/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:30.985591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab513-a9a8-4f4b-bd3b-bbc415b6b305 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:30.986120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab513-a9a8-4f4b-bd3b-bbc415b6b305 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:30.986441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ab513-a9a8-4f4b-bd3b-bbc415b6b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.061107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a36ab513-a9a8-4f4b-bd3b-bbc415b6b305 None None] MFA Rules not processed for user `dc9fe5a5f3564523b429cc71ab3eaa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:31.062909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a36ab513-a9a8-4f4b-bd3b-bbc415b6b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.071764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca37-13ee-4d8f-9d68-bbef2443aeac admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.101385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:31.157150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:31.170366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 926/1856] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:31.172068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.172367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.172740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.192485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.194175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.194175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.194175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] PATH_INFO: `/v3/users/f00ea5c318404ee6b54e2cbc34e635b8` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.195954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00ea5c318404ee6b54e2cbc34e635b8)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.198775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.230670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] MFA Rules not processed for user `f01938ff60c54cf98125dec5bfce1f48`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:31.233627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.314143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00ea5c318404ee6b54e2cbc34e635b8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:31.335437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00ea5c318404ee6b54e2cbc34e635b8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:31.336721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00ea5c318404ee6b54e2cbc34e635b8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:31.357690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00ea5c318404ee6b54e2cbc34e635b8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:31.387719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00ea5c318404ee6b54e2cbc34e635b8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:31.402708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 931/1857] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:30 2022] DELETE /identity/v3/users/f00ea5c318404ee6b54e2cbc34e635b8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:31.403909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:31.406429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.413683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 927/1858] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:31.421190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:31.423567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.445075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a3df3-d83c-408f-ac9b-e917ac3dded9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.534209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.536111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.536389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.537753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.538970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.541627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.554128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b18fb-d95e-4bd5-a7d9-12fdbb3bfd54 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.561592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.563057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.563529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.564005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.568281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.592776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 928/1859] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:31 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:31.594060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:31.596488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:31.799783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:31.804548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cecaf20-33fb-42ef-81cb-151e29e08a8c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.812362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.813234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.813526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.813808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.814837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.817353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.835454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.840057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.849999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 929/1860] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:31 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:31.852165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:31.859701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:31.863189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 932/1861] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:31.869038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a05cb9-38cc-4797-a7ec-dff7b490cf6b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.877382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.878412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.878693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.879040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.879958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.882128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.897766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:31.902115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:31.926089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6159f0-c4ac-42d6-865a-5b0d519f1c62 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:31.935168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:31.936612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:31.937359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:31.937956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] PATH_INFO: `/v3/projects/7ed4049911ad4d848dd0710b8640da35/users/4c3881d2c806443db0099cf759eb1266/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:31.974114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed4049911ad4d848dd0710b8640da35, user_id=4c3881d2c806443db0099cf759eb1266, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:31.978276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:31.998832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 933/1863] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:31 2022] PUT /identity/v3/projects/7ed4049911ad4d848dd0710b8640da35/users/4c3881d2c806443db0099cf759eb1266/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:32.004511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:32.019931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607fa52-159b-48ea-884a-03d7273c40c8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:32.119111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:32.120011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.120731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.121126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.131939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:32.131939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:32.159920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 931/1864] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:32.167094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:32.197745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba8b3-6657-455d-9bbb-8a9a9342da67 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:32.229574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:32.232150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.232965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.234807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] PATH_INFO: `/v3/projects/7ed4049911ad4d848dd0710b8640da35/users/4c3881d2c806443db0099cf759eb1266/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.244838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed4049911ad4d848dd0710b8640da35, user_id=4c3881d2c806443db0099cf759eb1266, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:32.252770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc00d53-9fa1-4c00-bfe0-813a1b4058f5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:32.278970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 934/1865] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:32 2022] PUT /identity/v3/projects/7ed4049911ad4d848dd0710b8640da35/users/4c3881d2c806443db0099cf759eb1266/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:32.291856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:32.301415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.301917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.302448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.306557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.350987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d2164-71f1-4406-b95f-e22d5f3cdcf4 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:32.387343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] MFA Rules not processed for user `4c3881d2c806443db0099cf759eb1266`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:32.401297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.501137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:32.502266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.502665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.503080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] PATH_INFO: `/v3/projects/5fda2309457e48b8b8685d842d2063a7` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.504596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fda2309457e48b8b8685d842d2063a7)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:32.507837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:32.590888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fda2309457e48b8b8685d842d2063a7', 'request_id': 'req-92020468-b9b7-4ff6-884d-7c5445b6dc1a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.599363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fda2309457e48b8b8685d842d2063a7', 'request_id': 'req-92020468-b9b7-4ff6-884d-7c5445b6dc1a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.601084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 935/1866] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:32.605812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:32.607432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.608933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fda2309457e48b8b8685d842d2063a7', 'request_id': 'req-92020468-b9b7-4ff6-884d-7c5445b6dc1a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.623160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602bd70-6150-4664-aae7-a87cad90c8ff None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:32.628975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] The token cache is being invalidate because project 5fda2309457e48b8b8685d842d2063a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:32.629439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.630320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.632154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 932/1867] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:32 2022] DELETE /identity/v3/projects/5fda2309457e48b8b8685d842d2063a7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:32.634983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:32.636957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.662328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:32.694822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:32.695719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.695999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.696763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] PATH_INFO: `/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.698365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2eefc2b44c4502ac34d226d72c1e8a)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:32.700574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:32.710672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92020468-b9b7-4ff6-884d-7c5445b6dc1a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:32.714762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badde695-310c-4797-baab-edee53c9975f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:32.715456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde695-310c-4797-baab-edee53c9975f service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.715751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde695-310c-4797-baab-edee53c9975f service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.716030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde695-310c-4797-baab-edee53c9975f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.718025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-badde695-310c-4797-baab-edee53c9975f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.768585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:32.780499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2eefc2b44c4502ac34d226d72c1e8a', 'request_id': 'req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.790618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2eefc2b44c4502ac34d226d72c1e8a', 'request_id': 'req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.802287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2eefc2b44c4502ac34d226d72c1e8a', 'request_id': 'req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.804480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badde695-310c-4797-baab-edee53c9975f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:32.806805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badde695-310c-4797-baab-edee53c9975f service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:32.818814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 933/1868] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:32.820430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6938-e956-486b-9a77-28989b951999 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.820905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6938-e956-486b-9a77-28989b951999 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.821408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6938-e956-486b-9a77-28989b951999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.824180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] The token cache is being invalidate because project 0b2eefc2b44c4502ac34d226d72c1e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:32.824598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.825856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4e87a10b-cdcc-4928-a9d2-ed845294fcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:32.828438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 936/1869] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:32 2022] DELETE /identity/v3/projects/0b2eefc2b44c4502ac34d226d72c1e8a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:32.833710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.834046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.834336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:32.854688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-400b6938-e956-486b-9a77-28989b951999 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:32.857430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-400b6938-e956-486b-9a77-28989b951999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.866969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:32.869728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:32.994350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 934/1870] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:32.997196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b94c64-477b-4282-bee2-ce6803da9043 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:32.997772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b94c64-477b-4282-bee2-ce6803da9043 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:32.997772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b94c64-477b-4282-bee2-ce6803da9043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.046708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-80b94c64-477b-4282-bee2-ce6803da9043 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:33.049064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-80b94c64-477b-4282-bee2-ce6803da9043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:33.133735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 937/1871] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:33.133735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.134463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 935/1872] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:33.142146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.143580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.145112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.151715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e6597-f048-4809-bdfc-b6f580106cfb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.185234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.189433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.191491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.191897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.193017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:33.194016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.199249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.203523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:33.211108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:33.225091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 938/1873] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:33.229630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.239164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 936/1874] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:33.242051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.242472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e859f-bf32-4b93-8e02-d97d442f3a52 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.248979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.249916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.250364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.250914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.251838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.254070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.271485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d73c84-43f3-4566-8e9f-7f5f14fd9996 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.285865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.286693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.287060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.287234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.288159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:33.288473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.302293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.309416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 939/1875] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:33 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:33.314948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.330133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 937/1876] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:33.335352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.354341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d49c9-9ff0-4dcd-a561-f7b5261163a6 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.463576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:33.487824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df223526-5580-41bb-a0f1-cec3b593f93a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.498349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.499273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.499633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.499832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.499969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.500605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.500799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.500891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.501192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.501916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.505667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.511847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.538621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 940/1877] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:33 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:33.543537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.599429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 938/1878] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:33 2022] POST /identity/v3/projects => generated 399 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:33.612183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.627784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57aaf3-36f3-456f-af64-4151deee8006 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.667801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:33.826470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658bea-49c9-4051-b5a3-94ce8f8cc1e4 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.829271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.830100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.830390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.830689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.831453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.833974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.835587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.836149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.836594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.837509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.837978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.839796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.872922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 939/1879] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:33 2022] POST /identity/v3/users => generated 300 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:33.875911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 941/1880] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:33.879951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.887456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.925502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d1074-a204-4510-a8c6-d36a58a0b7bb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.929630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69000aa1-dc68-447a-a9ed-0012eb35434e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:33.944537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.945601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:33.946199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.947041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:33.947531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.947707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:33.948157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.948312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:33.950081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.950293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:33.953515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.953902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:33.976642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 940/1881] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:33.977642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:33.997820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 942/1882] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:33.998128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4373-2a91-4478-844d-7c279859e424 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:34.000087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:34.000606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:34.000997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.001297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.001639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.003194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:34.005169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:34.026218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7d4-04a3-4ba6-a60e-2d131fdb5f7f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:34.028824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 941/1883] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:34.034676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:34.039155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:34.041813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.043729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.044352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] PATH_INFO: `/v3/projects/28d37a3c9eb94efeb26704e45c6fb3f2/users/77c19b05b6f0419487db1b6263ba1781/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.055098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241913-8517-4639-a779-c48f1cabc2c1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:34.065063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:34.066747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.067258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.067747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] PATH_INFO: `/v3/projects/6c849253bac84756b70e49bcff969e14/users/fdb9f30ee5a845faaccf0a030d170a63/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.112178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c849253bac84756b70e49bcff969e14, user_id=fdb9f30ee5a845faaccf0a030d170a63, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:34.119950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af54a-6200-4270-a999-1f432bb018e8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:34.141294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d37a3c9eb94efeb26704e45c6fb3f2, user_id=77c19b05b6f0419487db1b6263ba1781, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:34.149649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed5195-7c5c-4360-9042-621fb36e7e51 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:34.157293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 942/1884] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:34 2022] PUT /identity/v3/projects/6c849253bac84756b70e49bcff969e14/users/fdb9f30ee5a845faaccf0a030d170a63/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:34.185565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.186548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.187842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.192493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 943/1885] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:33 2022] PUT /identity/v3/projects/28d37a3c9eb94efeb26704e45c6fb3f2/users/77c19b05b6f0419487db1b6263ba1781/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:34.214766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.215214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.215684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.275120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] MFA Rules not processed for user `fdb9f30ee5a845faaccf0a030d170a63`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:34.277907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:34.315128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] MFA Rules not processed for user `77c19b05b6f0419487db1b6263ba1781`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:34.316698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:34.475002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 943/1886] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:34.482224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:34.494141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:34.580666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 944/1887] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:34.594003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:34.714521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2824ec-4140-4df9-818b-154553a456ea None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:34.723121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:34.724340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.724875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.725409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.726858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:34.731416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:34.801047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c471a2-f23e-444e-a817-ab21d12d9944 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:34.824086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 944/1888] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/projects => generated 401 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:34.824636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:34.825762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:34.826373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:34.826826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:34.827051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:34.828065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:34.830387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:34.875627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:34.909049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 945/1889] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:34.912864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.044275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7365b85-db0d-44b4-94cb-24840394a7f7 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.085544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ef6c-7fec-45be-ac35-3f434509bbb2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.104724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.105895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.106448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.106944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.107925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.114609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.177038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 946/1890] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:35.183144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.212112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e2481-a840-4538-aa8d-2ef0fbd241cc admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.238029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.238778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.239526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.239854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.240864 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.243082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.281566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 947/1891] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:35.290394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.294130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.294970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.295271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.295511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.298177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.302248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.313203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668434c-c0ac-4b13-add1-36db4f650eaf admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.329185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.333901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.335933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.336885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] PATH_INFO: `/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8/users/694ffafd084f4c21b47fee41b6f88253/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.362218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 945/1892] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:34 2022] POST /identity/v3/users => generated 307 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:35.368339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.384069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f676-e9bb-49c2-9cae-dc8059c213df admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.389838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.390311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce06122e69bd4f9abc56f7f2fa1758f8, user_id=694ffafd084f4c21b47fee41b6f88253, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.390797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.391632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.391924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.392720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.394615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.397080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.414139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 946/1893] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:35.416061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.430947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121e8b-0ec6-4e24-be78-44b7a75bdd29 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.445732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 948/1894] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:35 2022] PUT /identity/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8/users/694ffafd084f4c21b47fee41b6f88253/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:35.447905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.457389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:35.526182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.527493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.527922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.528276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] PATH_INFO: `/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6/users/e0351302031141d7a1cffbc1788a8778/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.553676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe62cf5b6fbc4f48bef20e5bb6012dc6, user_id=e0351302031141d7a1cffbc1788a8778, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.558231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.583011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 947/1895] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:35 2022] PUT /identity/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6/users/e0351302031141d7a1cffbc1788a8778/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:35.586820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.653292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49de01-cbaf-4030-a28d-1133ccdec359 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.712927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a3ea-6266-4557-914c-6d3eb9abd02f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.724080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.725436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.726124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.726787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.729662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.735666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.787603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 948/1896] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:35.793277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.826942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fe0c6-b354-4ce9-8660-8eca4fdb7689 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.837380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.839282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.839625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.839914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] PATH_INFO: `/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6/users/e0351302031141d7a1cffbc1788a8778/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.843526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe62cf5b6fbc4f48bef20e5bb6012dc6, user_id=e0351302031141d7a1cffbc1788a8778, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.850730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca009b81-ff84-4dec-a2ad-4c176688afd1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.876576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 949/1897] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:35 2022] PUT /identity/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6/users/e0351302031141d7a1cffbc1788a8778/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:35.880667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:35.882748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.883032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.883354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.884803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:35.886857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:35.898739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:35.899408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:35.900264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:35.901206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:35.917043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 949/1898] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:35.919558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:35.944091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812afa9a-fac7-445c-9974-82b968b438c4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:35.998722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] MFA Rules not processed for user `e0351302031141d7a1cffbc1788a8778`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:36.004154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.116917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:36.118155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.118360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.118650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] PATH_INFO: `/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8/users/694ffafd084f4c21b47fee41b6f88253/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.124571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce06122e69bd4f9abc56f7f2fa1758f8, user_id=694ffafd084f4c21b47fee41b6f88253, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:36.127570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62faee8-7227-4227-88c7-5c7209ae8157 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:36.171806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 950/1899] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:35 2022] PUT /identity/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8/users/694ffafd084f4c21b47fee41b6f88253/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:36.174192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.176348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.176348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.237298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] MFA Rules not processed for user `694ffafd084f4c21b47fee41b6f88253`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:36.238739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.288669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 950/1900] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:36.288669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:36.297322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.333133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182a6bc-561f-4d8e-ac63-ee10821b6685 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:36.344274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:36.425734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 951/1901] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:36.427097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:36.434325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.557654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:36.559362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.559849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.560338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] PATH_INFO: `/v3/users/f01938ff60c54cf98125dec5bfce1f48` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.563478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f01938ff60c54cf98125dec5bfce1f48)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:36.566210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04dca2-eeeb-4f30-a96a-630df6a987d8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:36.568683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:36.575204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:36.576347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.576971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.577457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.636066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:36.711253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:36.712878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:36.720715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f01938ff60c54cf98125dec5bfce1f48'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:36.721436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f01938ff60c54cf98125dec5bfce1f48'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:36.722094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f01938ff60c54cf98125dec5bfce1f48'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:36.734425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f01938ff60c54cf98125dec5bfce1f48'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:36.741688 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 952/1902] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:36.743678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:36.746511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.759677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-123a116c-3c6f-4ee7-a9a3-b81b7d4480db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f01938ff60c54cf98125dec5bfce1f48'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:36.789371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d1c6-3369-4f8a-825a-564cf45458b0 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:36.814465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:36.815570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.815860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.816200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.823277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.863109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 951/1903] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:36 2022] DELETE /identity/v3/users/f01938ff60c54cf98125dec5bfce1f48 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:36.865792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:36.866393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:36.866872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:36.874341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:36.877634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:36.906545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:36.909641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:36.912459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 953/1904] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:37.059383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:37.064471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.091255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5708-6511-4e9a-98b5-26027da81440 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:37.099715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 952/1905] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:37.101282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:37.103217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.105223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:37.106667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:37.107023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:37.107305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] PATH_INFO: `/v3/users/77c19b05b6f0419487db1b6263ba1781` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:37.109422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c19b05b6f0419487db1b6263ba1781)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:37.113262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:37.147818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:37.187188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b35dd4-a885-4248-9232-489c734d61a8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:37.192082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:37.193769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:37.194238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:37.194865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:37.197851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.205387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c19b05b6f0419487db1b6263ba1781'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:37.219588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c19b05b6f0419487db1b6263ba1781'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:37.220332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c19b05b6f0419487db1b6263ba1781'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:37.233487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c19b05b6f0419487db1b6263ba1781'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:37.249899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c19b05b6f0419487db1b6263ba1781'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:37.257119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 954/1906] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:37 2022] DELETE /identity/v3/users/77c19b05b6f0419487db1b6263ba1781 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:37.258120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:37.260526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.301973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:37.304743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3e1f1-681f-4723-aebc-c855eebf8796 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:37.319358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 953/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:37.320884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:37.321350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:37.321694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:37.329478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75c351-d0d0-42fe-a950-96c19689c723 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:37.334089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:37.334766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:37.335053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:37.335325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:37.337912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.342509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:37.343959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.405242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:37.424126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 954/1908] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:37.434587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:37.436701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:37.449776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b8429-4753-4554-99fe-ab47d72c2962 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:37.455342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:37.456021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:37.456300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:37.456573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:37.457768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:37.461176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:37.468052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:37.469747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:37.483241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 955/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:37.487768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 955/1910] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:38.078916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:38.080832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:38.099867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69e4ca-d4e9-4226-a51b-2311fcaaa890 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:38.109571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:38.111860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.112281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.112835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] PATH_INFO: `/v3/projects/4f1a9871fcd4412480c47fefe125b8b2` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.114677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1a9871fcd4412480c47fefe125b8b2)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:38.116803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:38.185191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1a9871fcd4412480c47fefe125b8b2', 'request_id': 'req-4f4abe57-8ec4-4603-9236-673ed052d0e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.192991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1a9871fcd4412480c47fefe125b8b2', 'request_id': 'req-4f4abe57-8ec4-4603-9236-673ed052d0e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.201967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1a9871fcd4412480c47fefe125b8b2', 'request_id': 'req-4f4abe57-8ec4-4603-9236-673ed052d0e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.204487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:38.232538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] The token cache is being invalidate because project 4f1a9871fcd4412480c47fefe125b8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:38.233154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.234601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.238138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 956/1911] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:38 2022] DELETE /identity/v3/projects/4f1a9871fcd4412480c47fefe125b8b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:38.242478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:38.261419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96e54-5273-4afa-b9d0-ce81d9ca90f1 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:38.444220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:38.448715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:38.470443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:38.472087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.472429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.472913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] PATH_INFO: `/v3/users/4c3881d2c806443db0099cf759eb1266` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.474155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3881d2c806443db0099cf759eb1266)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:38.476263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:38.479653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4abe57-8ec4-4603-9236-673ed052d0e8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:38.496453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:38.500056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.501343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.502432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] PATH_INFO: `/v3/projects/28d37a3c9eb94efeb26704e45c6fb3f2` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.509076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d37a3c9eb94efeb26704e45c6fb3f2)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:38.515106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:38.570047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3881d2c806443db0099cf759eb1266'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.589243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3881d2c806443db0099cf759eb1266'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.590750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3881d2c806443db0099cf759eb1266'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.608221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3881d2c806443db0099cf759eb1266'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.641059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3881d2c806443db0099cf759eb1266'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.647705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d37a3c9eb94efeb26704e45c6fb3f2', 'request_id': 'req-67714235-bf10-4b2d-b45a-018790358f40'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.655092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 956/1912] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:38 2022] DELETE /identity/v3/users/4c3881d2c806443db0099cf759eb1266 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:38.661232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d37a3c9eb94efeb26704e45c6fb3f2', 'request_id': 'req-67714235-bf10-4b2d-b45a-018790358f40'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.672238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d37a3c9eb94efeb26704e45c6fb3f2', 'request_id': 'req-67714235-bf10-4b2d-b45a-018790358f40'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.694907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] The token cache is being invalidate because project 28d37a3c9eb94efeb26704e45c6fb3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:38.695302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.696831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67714235-bf10-4b2d-b45a-018790358f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:38.700983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 957/1913] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:38 2022] DELETE /identity/v3/projects/28d37a3c9eb94efeb26704e45c6fb3f2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:38.708083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:38.721324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:38.741115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29ccc-dae1-446b-9eda-f3632892aa3f None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.741596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29ccc-dae1-446b-9eda-f3632892aa3f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.742105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d29ccc-dae1-446b-9eda-f3632892aa3f None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.745492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 958/1914] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:47:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:47:38.759196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544423-8387-4982-81da-901c918cab26 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.759947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544423-8387-4982-81da-901c918cab26 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.760824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51544423-8387-4982-81da-901c918cab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.832595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-51544423-8387-4982-81da-901c918cab26 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:38.835121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-51544423-8387-4982-81da-901c918cab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:38.853726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:38.887439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f9068-20ac-495b-886f-5325cdf2b5e9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:38.914692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:38.915910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:38.917605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:38.917920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] PATH_INFO: `/v3/users/694ffafd084f4c21b47fee41b6f88253` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:38.928241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=694ffafd084f4c21b47fee41b6f88253)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:38.932647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:39.007867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 959/1915] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:47:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:39.039860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544423-8387-4982-81da-901c918cab26 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:39.041670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-51544423-8387-4982-81da-901c918cab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.050479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694ffafd084f4c21b47fee41b6f88253'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.076934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51544423-8387-4982-81da-901c918cab26 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:39.080965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694ffafd084f4c21b47fee41b6f88253'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.083076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694ffafd084f4c21b47fee41b6f88253'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.093869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:39.094733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.095020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.095301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.100230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694ffafd084f4c21b47fee41b6f88253'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.116455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:39.121119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:39.143712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694ffafd084f4c21b47fee41b6f88253'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.148984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 960/1916] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:39.152263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 957/1917] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:38 2022] DELETE /identity/v3/users/694ffafd084f4c21b47fee41b6f88253 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:39.265697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:39.267728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.293494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da371169-c8ed-4bfc-9738-bdd5ec6e0392 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:39.394623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:39.397452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.434355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:39.494410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:39.496459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.497104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.497104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] PATH_INFO: `/v3/projects/7ed4049911ad4d848dd0710b8640da35` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.498677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed4049911ad4d848dd0710b8640da35)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:39.509138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:39.577635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e735d-9f9f-4943-85d5-0c6907720eb4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:39.583578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:39.584573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.584853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.585136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] PATH_INFO: `/v3/users/dc9fe5a5f3564523b429cc71ab3eaa3f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.588670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9fe5a5f3564523b429cc71ab3eaa3f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:39.590865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:39.630947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed4049911ad4d848dd0710b8640da35', 'request_id': 'req-599e16d0-e5fd-4877-b22f-75c1610fd6df'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.647664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed4049911ad4d848dd0710b8640da35', 'request_id': 'req-599e16d0-e5fd-4877-b22f-75c1610fd6df'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.665047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed4049911ad4d848dd0710b8640da35', 'request_id': 'req-599e16d0-e5fd-4877-b22f-75c1610fd6df'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.696356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] The token cache is being invalidate because project 7ed4049911ad4d848dd0710b8640da35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:39.696796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.698176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-599e16d0-e5fd-4877-b22f-75c1610fd6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.702341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 961/1918] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:39 2022] DELETE /identity/v3/projects/7ed4049911ad4d848dd0710b8640da35 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:39.706265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e655d7-2a60-4ffa-b403-a3cf7168d3e4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.706530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e655d7-2a60-4ffa-b403-a3cf7168d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.706930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e655d7-2a60-4ffa-b403-a3cf7168d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.711458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9fe5a5f3564523b429cc71ab3eaa3f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.720824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9fe5a5f3564523b429cc71ab3eaa3f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.722248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9fe5a5f3564523b429cc71ab3eaa3f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.737963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9fe5a5f3564523b429cc71ab3eaa3f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.763145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-72e655d7-2a60-4ffa-b403-a3cf7168d3e4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:39.764554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-72e655d7-2a60-4ffa-b403-a3cf7168d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.767626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:39.784625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06a28340-eab6-4cec-b933-9c334b83f729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9fe5a5f3564523b429cc71ab3eaa3f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:39.797632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 958/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:39 2022] DELETE /identity/v3/users/dc9fe5a5f3564523b429cc71ab3eaa3f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:39.803549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.803823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.804100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.853190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:39.859655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.916616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 962/1920] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:39.928829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:39.929522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:39.930144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:39.982352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:39.982352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:39.995959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 959/1921] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:40.006058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 963/1922] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:40.010703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.010924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.012771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.022461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3b2b-ef5a-492e-903b-3518a657afde None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.035710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.036448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.036777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.037086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.037849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:40.038214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.049646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.076575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 964/1923] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:47:40.077965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.088447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.124012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbe645-b208-4126-be8f-60334157a313 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.133446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.135277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.135849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.136369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] PATH_INFO: `/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.141058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef9ea-666d-4040-ba50-23179cc26524 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.141620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce06122e69bd4f9abc56f7f2fa1758f8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.146159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.160999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.161816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.162138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.162422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.197241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.203060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.228120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 960/1924] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:40.229582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.246780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5a656-4086-4d6a-a26f-9092841ca43c service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.256947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.257818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.258140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.258452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.261369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.262524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.274076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce06122e69bd4f9abc56f7f2fa1758f8', 'request_id': 'req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:40.282332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce06122e69bd4f9abc56f7f2fa1758f8', 'request_id': 'req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:40.285541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:40.295207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce06122e69bd4f9abc56f7f2fa1758f8', 'request_id': 'req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:40.304431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 961/1925] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:40.309428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.320762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] The token cache is being invalidate because project ce06122e69bd4f9abc56f7f2fa1758f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:40.321284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:40.322597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ee34830-ed9c-4cb2-8a73-8b1d011f66b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:40.329465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 965/1926] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:40 2022] DELETE /identity/v3/projects/ce06122e69bd4f9abc56f7f2fa1758f8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:40.331540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2cd4-7f1c-4674-9078-d497d4bf3159 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.331899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2cd4-7f1c-4674-9078-d497d4bf3159 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.332177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f2cd4-7f1c-4674-9078-d497d4bf3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.384611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3c2f2cd4-7f1c-4674-9078-d497d4bf3159 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:40.388858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3c2f2cd4-7f1c-4674-9078-d497d4bf3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.393123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d764f-bd83-4399-8da8-aa5ecc047bfe admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.400636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.401349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.401634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.401980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.403019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.405221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.423394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 966/1927] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:40.425854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.427894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.428201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.445601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 962/1928] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:40.446496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.453983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.470165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:40.477891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:40.479186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.483913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ace1d-8c07-4079-9d47-c2e64a8ff44a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.496766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.500427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 967/1929] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:40.503185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.503708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.504112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.505239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.508333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.508960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.525124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846449d-b969-40f9-be68-fd3503fbd471 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.533229 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.534393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.537844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 963/1930] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:40.538741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.538884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.539322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.540471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:40.540903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.542818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.566698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7334225-ecc8-4183-913e-1a7493dbe3d0 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.568338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 968/1931] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:40.569529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.582578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.584156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.584559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.585013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.586143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.588616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.598511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c45285-09c3-4795-be2d-3ca9d3c97647 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.618659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 964/1932] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:40.623851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.624642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.624933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.625212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.625933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.627495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.630708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.651017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4b0f3-3a5d-4168-91a8-df9d6ef61463 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.668469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.669902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.669902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.670136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] PATH_INFO: `/v3/projects/6f67938ad67c46fc802c1d1e03f935fe/users/e47ff0e3e031446f805e5a9718181a0c/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.697197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 969/1933] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:40.697764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f67938ad67c46fc802c1d1e03f935fe, user_id=e47ff0e3e031446f805e5a9718181a0c, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.697764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a2a7d-3250-4e42-aa97-f81e2b85c214 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.699151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.720457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 965/1934] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:40 2022] PUT /identity/v3/projects/6f67938ad67c46fc802c1d1e03f935fe/users/e47ff0e3e031446f805e5a9718181a0c/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:40.731469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.732026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.732231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.773163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] MFA Rules not processed for user `e47ff0e3e031446f805e5a9718181a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:40.774538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.805010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9169d-7dc7-45b5-88ef-90b94f49d859 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.872755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 966/1935] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:40.888602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.890451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:40.896064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.896868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.897034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.897322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.898217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.900851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:40.932301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 970/1936] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:40 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:40.933544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:40.947085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb85e9-7140-4e35-9608-7e49ea01c4c8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:40.953260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:40.954807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:40.955239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:40.955715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:40.957155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:40.959279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.001735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 971/1937] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:41.003413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.021348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13573-7db3-4edd-b233-77db3027c8cd admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.029549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a931c-bbf7-4e79-ae82-dff6ecabbf8d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.059265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.060081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.063578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.064964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.064964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.064964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.066154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.066492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.067275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.071956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.091172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.092757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.093603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 972/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:41.094677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.097493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:41.111104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 967/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:41.118603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.127036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62033e1e-cdb0-49f0-9494-92950a7ff0bc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.156064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.157042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.157328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.158537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] PATH_INFO: `/v3/projects/5ead242984a14ce6b46c46a2679925ce` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.159455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3e04-0f17-47c0-8fed-146d4396b73e service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.162215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ead242984a14ce6b46c46a2679925ce)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.168108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.179923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.181736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.182279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.183786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] PATH_INFO: `/v3/projects/81448a747e9a439aaba595d58c401e3d/users/e1aef9a632204dc6ae221a186e98cfb0/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.191058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:41.249311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81448a747e9a439aaba595d58c401e3d, user_id=e1aef9a632204dc6ae221a186e98cfb0, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.259367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163fc04-1eb3-4684-a392-7199c2f98f4b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.289308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 968/1940] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:41 2022] PUT /identity/v3/projects/81448a747e9a439aaba595d58c401e3d/users/e1aef9a632204dc6ae221a186e98cfb0/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:41.315704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.316212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.316566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.322567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ead242984a14ce6b46c46a2679925ce', 'request_id': 'req-28dcb172-aeb9-43cb-beee-be5863c7d1e3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:41.345133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ead242984a14ce6b46c46a2679925ce', 'request_id': 'req-28dcb172-aeb9-43cb-beee-be5863c7d1e3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:41.359435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ead242984a14ce6b46c46a2679925ce', 'request_id': 'req-28dcb172-aeb9-43cb-beee-be5863c7d1e3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:41.381732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] The token cache is being invalidate because project 5ead242984a14ce6b46c46a2679925ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:41.382183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:41.384258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-28dcb172-aeb9-43cb-beee-be5863c7d1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:41.391389 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 973/1941] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:41 2022] DELETE /identity/v3/projects/5ead242984a14ce6b46c46a2679925ce => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:41.393768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9a80-b03a-4543-a9e5-f98efdbaf024 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.394096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9a80-b03a-4543-a9e5-f98efdbaf024 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.394403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d9a80-b03a-4543-a9e5-f98efdbaf024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.401604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] MFA Rules not processed for user `e1aef9a632204dc6ae221a186e98cfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:41.402814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:41.440640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-810d9a80-b03a-4543-a9e5-f98efdbaf024 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:41.442109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-810d9a80-b03a-4543-a9e5-f98efdbaf024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:41.453750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:41.545444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 974/1942] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:41.547555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.547853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.548124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.556912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 969/1943] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:41.560254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.562139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:41.582047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720a5c4-1217-4227-bfac-dcfa9a21cf93 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.588659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.589797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.590510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.591013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.591126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:41.592247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.593448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:41.598107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.624380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 975/1944] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:41.632037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.650443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2d7a1-310c-4be1-bcc3-a59698ba72b2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.657829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.658992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.659558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.659885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.660802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:41.661217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.661362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 970/1945] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:41.671567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.679529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.701992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 976/1946] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:41.704473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.721165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b10c0-afb3-45b9-a041-ecb7145adb0c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.828999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.829706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.830050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.830319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.831172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.833216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.844896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c982fea-6848-49a1-b91a-d966773bce4f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:41.866990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:41.871128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:41.874127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:41.877723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:41.882333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:41.887127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:41.924535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 977/1947] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/projects => generated 359 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:41.929318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.937142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 971/1948] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:41.944585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:41.946133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:41.989378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec869d6-0442-4240-a31a-a92aef8d2a79 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.130008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405308-86fc-45a1-9001-fc8660c4831c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.142147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.142971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.143428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.143995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.146440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.149547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.201119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 978/1949] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:41 2022] POST /identity/v3/users => generated 280 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:42.206986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.213565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.215355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.216092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.216971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.219313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.223222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.246623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9570149-8b29-4ff1-a17f-384abd25de57 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.254593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 972/1950] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:42.258221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.272809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.273931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.274201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2493-b9f1-48d4-8509-7baec41a71cb admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.274745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.275104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.275889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.278080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.279493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.280584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.281107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.281562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] PATH_INFO: `/v3/projects/1f51a3c2731a4d35b5519eb3d405717d/users/51311f0db84947f9b3a578583fbdc18e/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.298522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 979/1951] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:42.303747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.305609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f51a3c2731a4d35b5519eb3d405717d, user_id=51311f0db84947f9b3a578583fbdc18e, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.308631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.311706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:42.324312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544d29e-e882-4309-93ce-a1f72ba0e3db admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.330283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 973/1952] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:42 2022] PUT /identity/v3/projects/1f51a3c2731a4d35b5519eb3d405717d/users/51311f0db84947f9b3a578583fbdc18e/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:42.332518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.448907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.450587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.451304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.451944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.453312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.457247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.472590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209f0db-d03b-4040-adb8-3975c8d7bc2e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.479165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.479877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.480345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.480657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.481360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.487146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 980/1953] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:42.487368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.489369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.494759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 974/1954] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:42.499238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.514533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba3116-ee5d-488b-a47d-e238a9cdfcf7 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.527663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947604d-5feb-4932-a62e-bdfe37c9946b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.546804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.547811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.548221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.548392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.548602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] PATH_INFO: `/v3/projects/b3b6efccd0e546f4a0d1b6511f4dfc2f/users/5383b7225ffe472c892274c51cb76af1/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.549239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.549457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.549733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] PATH_INFO: `/v3/projects/1f51a3c2731a4d35b5519eb3d405717d/users/51311f0db84947f9b3a578583fbdc18e/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.556671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f51a3c2731a4d35b5519eb3d405717d, user_id=51311f0db84947f9b3a578583fbdc18e, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.559406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c73a2c-798e-4df9-bc19-508eea52059e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.581493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 975/1955] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:42 2022] PUT /identity/v3/projects/1f51a3c2731a4d35b5519eb3d405717d/users/51311f0db84947f9b3a578583fbdc18e/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:42.585862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.586242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.586595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.586811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b6efccd0e546f4a0d1b6511f4dfc2f, user_id=5383b7225ffe472c892274c51cb76af1, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.590431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478b629-206d-475c-84f8-cf4161d919d8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.629983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 981/1956] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:42 2022] PUT /identity/v3/projects/b3b6efccd0e546f4a0d1b6511f4dfc2f/users/5383b7225ffe472c892274c51cb76af1/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:42.633133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] MFA Rules not processed for user `51311f0db84947f9b3a578583fbdc18e`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:42.639348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:42.639779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.640080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.640445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.715789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] MFA Rules not processed for user `5383b7225ffe472c892274c51cb76af1`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:42.721782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:42.819895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 976/1957] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:42.834131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:42.839130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:42.849307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:42.904763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 982/1958] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:42.943876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bc19d-a755-4b74-b83a-0c19d0c274be None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:42.950251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:42.951330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:42.951795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:42.952246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:42.973842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:42.976433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:42.997221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 977/1959] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:43.009367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.011091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:43.031704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.034423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:43.044285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:43.049594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653e898-dda0-4c84-af10-e55a916ba96a service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.057208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.058376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.059057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.059326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.071270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.073449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.084880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 978/1960] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:43 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:43.086287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.103372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad092d-34b8-4558-9825-ea76c210ebda service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.108687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.109366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.109650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.109924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.143400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6251ec-4bb6-44ee-bd7f-917b01fe3079 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.158968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.160232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.160518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.160909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] PATH_INFO: `/v3/users/fdb9f30ee5a845faaccf0a030d170a63` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.164137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb9f30ee5a845faaccf0a030d170a63)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.168158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.203089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.204675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.215209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 979/1961] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:43.216074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.231725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5266f-e9d3-4954-8961-178665818081 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.237266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.238402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.238785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.239156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] PATH_INFO: `/v3/users/5383b7225ffe472c892274c51cb76af1` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.240799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5383b7225ffe472c892274c51cb76af1)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.245361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.294396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb9f30ee5a845faaccf0a030d170a63'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.295512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb9f30ee5a845faaccf0a030d170a63'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.296144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb9f30ee5a845faaccf0a030d170a63'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.308897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb9f30ee5a845faaccf0a030d170a63'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.324019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2e7a182a-350b-4b77-8557-db1243ffded3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb9f30ee5a845faaccf0a030d170a63'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.325481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5383b7225ffe472c892274c51cb76af1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.335017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5383b7225ffe472c892274c51cb76af1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.335750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5383b7225ffe472c892274c51cb76af1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.347073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5383b7225ffe472c892274c51cb76af1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.354780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 983/1962] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:43 2022] DELETE /identity/v3/users/fdb9f30ee5a845faaccf0a030d170a63 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:43.360591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.360894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.361316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.371197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-75f9eb4c-1c97-465e-9d16-65b7ba112353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5383b7225ffe472c892274c51cb76af1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:43.390011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 980/1963] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:43 2022] DELETE /identity/v3/users/5383b7225ffe472c892274c51cb76af1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:43.390615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:43.391770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.392088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:43.392188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.392554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.462632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:43.463925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:43.511140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 984/1964] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:43.520134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.521820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:43.534754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:43.627367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 981/1965] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:43.637599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:43.645505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:43.651331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16445d04-1d7d-4a8d-9605-497a490c19f9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.658444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a279651-7510-4444-aaf1-4477ec6d9988 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:43.660113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.660910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.661243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.664143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.670761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:43.672143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:43.674065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:43.674513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:43.676123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.679063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.699494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 982/1966] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:43.700332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:43.701830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:43.733522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 985/1967] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:44.751129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:44.753907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:44.800325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867f071-931b-4930-8346-d6298b3944f2 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:44.814094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:44.815972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:44.816253 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:44.816564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] PATH_INFO: `/v3/projects/b3b6efccd0e546f4a0d1b6511f4dfc2f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:44.828301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b6efccd0e546f4a0d1b6511f4dfc2f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:44.828785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:44.830694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:44.840573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:44.848278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599ecef-f156-4949-ac81-9ce9429bfbc4 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:44.855908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:44.856419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:44.856863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:44.857292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] PATH_INFO: `/v3/projects/6c849253bac84756b70e49bcff969e14` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:44.859004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c849253bac84756b70e49bcff969e14)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:44.861377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:44.937742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b6efccd0e546f4a0d1b6511f4dfc2f', 'request_id': 'req-3507dd04-b75d-438a-8df8-da440fa808c8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:44.952411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b6efccd0e546f4a0d1b6511f4dfc2f', 'request_id': 'req-3507dd04-b75d-438a-8df8-da440fa808c8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:44.969474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b6efccd0e546f4a0d1b6511f4dfc2f', 'request_id': 'req-3507dd04-b75d-438a-8df8-da440fa808c8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.001225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] The token cache is being invalidate because project b3b6efccd0e546f4a0d1b6511f4dfc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:45.003146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.004394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3507dd04-b75d-438a-8df8-da440fa808c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.007073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c849253bac84756b70e49bcff969e14', 'request_id': 'req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.012183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 983/1968] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:44 2022] DELETE /identity/v3/projects/b3b6efccd0e546f4a0d1b6511f4dfc2f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:45.016269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64a36-2bbd-4b77-995a-a2f201f8f90c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.016569 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64a36-2bbd-4b77-995a-a2f201f8f90c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.016857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e64a36-2bbd-4b77-995a-a2f201f8f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.027998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c849253bac84756b70e49bcff969e14', 'request_id': 'req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.051591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c849253bac84756b70e49bcff969e14', 'request_id': 'req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.094367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] The token cache is being invalidate because project 6c849253bac84756b70e49bcff969e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:45.094743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-61e64a36-2bbd-4b77-995a-a2f201f8f90c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:45.099452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-61e64a36-2bbd-4b77-995a-a2f201f8f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:45.106536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.107747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.113706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 986/1969] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:44 2022] DELETE /identity/v3/projects/6c849253bac84756b70e49bcff969e14 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:45.115079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:45.120611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:45.286015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 984/1970] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:45.295139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.295497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.295707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.319739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:45.321306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:45.335629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 985/1971] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:45.336821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:45.344084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5ccbb-cb46-4601-b0b7-0f73bb2e20c8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:45.348799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e0d4f-99f3-48b3-8d09-7cb4683cce34 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:45.356379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:45.356557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:45.357665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.358161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.358387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.358778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.359141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.359778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] PATH_INFO: `/v3/users/e0351302031141d7a1cffbc1788a8778` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.360170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:45.360813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:45.362900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:45.365521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0351302031141d7a1cffbc1788a8778)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:45.368749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:45.400351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 986/1972] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:45.406705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:45.431233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:45.438639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f76b0-5d12-42b4-b66e-e1e94d35ce51 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:45.468918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0351302031141d7a1cffbc1788a8778'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.469738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0351302031141d7a1cffbc1788a8778'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.470618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0351302031141d7a1cffbc1788a8778'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.474554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:45.475845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.476286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.476727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.478313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:45.484254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:45.493880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0351302031141d7a1cffbc1788a8778'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.516970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0351302031141d7a1cffbc1788a8778'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:45.549038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 987/1973] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:45 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:45.552939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:45.555868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:45.568875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 987/1974] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:45 2022] DELETE /identity/v3/users/e0351302031141d7a1cffbc1788a8778 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:45.612883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:45.704344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25ff6b-b88b-4126-92b7-232b614b5a4a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:45.873642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:45.874663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.874999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.877369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.880789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:45.883073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:45.944348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 988/1975] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:45 2022] POST /identity/v3/users => generated 284 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:45.948068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:45.976466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b26b0a-da3d-4009-9e58-0696e5acfc3b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:45.983398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:45.984407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:45.984844 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:45.985898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:45.987211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:45.989232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:46.002018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 988/1976] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:46.007837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:46.021200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b2c8-737c-4fd7-9e0c-92773d133f58 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:46.028029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:46.028790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.029604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.030022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.030940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:46.035356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f7fcf-c700-462f-b09c-fd21062959f5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:46.077221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 989/1977] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:46.079430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:46.096154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816863f3-0cc8-4610-a0b0-2aac129c8564 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:46.110358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:46.112349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.112738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.115369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] PATH_INFO: `/v3/projects/d6fdb41c241e4c85ad94d4f47f8f22be/users/813ee9cdd04f43c4a0bf7602cd94024e/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.158500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fdb41c241e4c85ad94d4f47f8f22be, user_id=813ee9cdd04f43c4a0bf7602cd94024e, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:46.175909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:46.210310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 989/1978] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:46 2022] PUT /identity/v3/projects/d6fdb41c241e4c85ad94d4f47f8f22be/users/813ee9cdd04f43c4a0bf7602cd94024e/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:46.231472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.231955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.232515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.291036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] MFA Rules not processed for user `813ee9cdd04f43c4a0bf7602cd94024e`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:46.293578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:46.406875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:46.410153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:46.503549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 990/1979] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:46.519827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:46.523269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:46.582671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf77f89-1ece-44be-a59c-d2f09551b653 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:46.589422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:46.590922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.591435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.592026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] PATH_INFO: `/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.593710 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe62cf5b6fbc4f48bef20e5bb6012dc6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:46.596383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:46.625566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:46.637008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cdd3c-4f90-4080-aeed-c0fb08d6ab17 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:46.650075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:46.651233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.651739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.652241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.688622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:46.691491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277d74b-1e42-4506-ac38-4f1c8c785ae3 service glance] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:46.749067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 991/1980] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:46.794974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe62cf5b6fbc4f48bef20e5bb6012dc6', 'request_id': 'req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:46.816644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe62cf5b6fbc4f48bef20e5bb6012dc6', 'request_id': 'req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:46.837144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe62cf5b6fbc4f48bef20e5bb6012dc6', 'request_id': 'req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:46.859862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] The token cache is being invalidate because project fe62cf5b6fbc4f48bef20e5bb6012dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:46.860307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:46.861328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3ec90d1e-cc3a-4c43-b33b-919ca29f110b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:46.863830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 990/1981] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:46 2022] DELETE /identity/v3/projects/fe62cf5b6fbc4f48bef20e5bb6012dc6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:46.868883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:46.869178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:46.869458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:46.901472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:46.906644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:47.112543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 992/1982] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:47.127379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.127953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.128342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.138355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:47.165795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:47.168598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:47.190030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 991/1983] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:47.196637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:47.225178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4a5c0-3562-48fd-a6de-fd9a6b24911d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:47.235468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:47.236290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.236678 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.237123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.238405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:47.238966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:47.241436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:47.263531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 993/1984] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:47.269912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:47.310975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f4770-33e2-4f3a-bae0-b406c60bdb05 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:47.337538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:47.344469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.344469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.344469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.346330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:47.359499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:47.467003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 992/1985] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:47.469064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:47.488011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd48f0-eaf9-406b-8837-d09cebb858f7 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:47.733959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:47.745039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.745039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.745039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.745039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:47.745824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:47.808084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 994/1986] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:47 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:47.813146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:47.839291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99db94-ef33-4ccc-8aa2-ea763367e692 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:47.874893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:47.874893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.874893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.874893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.875502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:47.875502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:47.904683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 993/1987] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:47.910807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:47.932837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db632ef7-8dd0-4c9a-8dff-f07aa85d6e6f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:47.944102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:47.944982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:47.945372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:47.945884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:47.947194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:47.950104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac18e24-b45a-41d6-ab02-a2e3ae5ee0f8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:47.983127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 995/1988] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:47.999029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:48.009983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40026df7-a72c-4e29-bf0b-73a23c4a667d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:48.009983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:48.009983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:48.009983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:48.010943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] PATH_INFO: `/v3/projects/6e11f7e8db02465d9ffcc930ef47abef/users/bb748df66fb34930af20851cf480d680/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:48.058346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11f7e8db02465d9ffcc930ef47abef, user_id=bb748df66fb34930af20851cf480d680, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:48.074733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:48.121333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 994/1989] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:47 2022] PUT /identity/v3/projects/6e11f7e8db02465d9ffcc930ef47abef/users/bb748df66fb34930af20851cf480d680/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:48.151297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:48.151621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:48.152050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:48.266040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] MFA Rules not processed for user `bb748df66fb34930af20851cf480d680`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:48.269420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:48.341402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:48.378139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 996/1990] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:48.379852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:48.431878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:48.434571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:48.633890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3fec4-c95a-46dc-bc5e-f63e846c694c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:48.660230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:48.663291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:48.666334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:48.667119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:48.670078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:48.678557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:48.714395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0713-fb34-4ae8-beb2-fe691f394848 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:48.750594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:48.751171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:48.751423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:48.751652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] PATH_INFO: `/v3/users/e1aef9a632204dc6ae221a186e98cfb0` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:48.753444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1aef9a632204dc6ae221a186e98cfb0)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:48.759136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:48.860806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 995/1991] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:48 2022] POST /identity/v3/projects => generated 381 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:48.865793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1aef9a632204dc6ae221a186e98cfb0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:48.867936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:48.907882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1aef9a632204dc6ae221a186e98cfb0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:48.908674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1aef9a632204dc6ae221a186e98cfb0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:48.929292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1aef9a632204dc6ae221a186e98cfb0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:48.967730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e4274228-9e7d-42bd-bf88-8ee15a3414fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1aef9a632204dc6ae221a186e98cfb0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:48.983461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 997/1992] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:48 2022] DELETE /identity/v3/users/e1aef9a632204dc6ae221a186e98cfb0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:48.998793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.001557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.002254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.120523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:49.126699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:49.178870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e64d0a-6e6c-4cdb-ad55-4296e9c23716 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:49.286337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 998/1993] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:49.303867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:49.306062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:49.313134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:49.317121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:49.391888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:49.393185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.394537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.394537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.396850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:49.401716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:49.428465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c0049-d6f8-47a1-9131-ac1d4b174d81 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:49.453536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:49.454943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 996/1994] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:48 2022] POST /identity/v3/users => generated 297 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:49.455318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.455846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.456239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.461478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:49.464605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:49.492460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:49.502238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302449e5-f28c-4500-b6b9-26073582b139 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:49.513357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:49.515253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.515842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.516484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.517689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:49.518111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:49.522555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:49.564430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 997/1995] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:49.569041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:49.604071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 999/1996] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:49.607717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9932de-a55a-45f3-98db-c4d087fb2578 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:49.626272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:49.627462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.627758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.628104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] PATH_INFO: `/v3/projects/c641749539ca4b9ebed55dcfa160c931/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.675219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c641749539ca4b9ebed55dcfa160c931, user_id=e3b8990d296e4b6fb8ad38ca2bdfa7b9, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:49.694439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:49.746013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 998/1997] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:49 2022] PUT /identity/v3/projects/c641749539ca4b9ebed55dcfa160c931/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:49.748411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:49.795641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446667-d047-47a5-8913-bb5ad6b4162e service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:49.932899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:49.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:49.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:49.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:49.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:49.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524c77-61ba-401b-a46b-6dd5b394db89 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:49.960307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1000/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:49.961586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:49.980579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27b68-558b-43e7-ad53-62757ad3c172 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:50.007730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:50.009573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:50.010070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:50.010533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] PATH_INFO: `/v3/projects/c641749539ca4b9ebed55dcfa160c931/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:50.031633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c641749539ca4b9ebed55dcfa160c931, user_id=e3b8990d296e4b6fb8ad38ca2bdfa7b9, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:50.045117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:50.113332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 999/1999] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:49 2022] PUT /identity/v3/projects/c641749539ca4b9ebed55dcfa160c931/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:50.126554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:50.126944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:50.127231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:50.231791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] MFA Rules not processed for user `e3b8990d296e4b6fb8ad38ca2bdfa7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:50.236946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:50.409638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:50.414654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:50.496609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1001/2000] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:50.510293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:50.513427 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:50.609582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:50.634211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a098ee2-49b2-41c7-815a-31004a224b21 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:50.651246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:50.667054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:50.670727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:50.671287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] PATH_INFO: `/v3/projects/81448a747e9a439aaba595d58c401e3d` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:50.677443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81448a747e9a439aaba595d58c401e3d)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:50.688497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:50.756563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5727f1-34ba-45cf-891e-6d7002fee6c2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:50.784860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:50.785566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:50.785895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:50.788379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:50.812117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:50.812117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:50.838320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1002/2001] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:50.886634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81448a747e9a439aaba595d58c401e3d', 'request_id': 'req-85b3cd13-9ebb-4c28-969c-407582f1d818'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:50.904011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81448a747e9a439aaba595d58c401e3d', 'request_id': 'req-85b3cd13-9ebb-4c28-969c-407582f1d818'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:50.918008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81448a747e9a439aaba595d58c401e3d', 'request_id': 'req-85b3cd13-9ebb-4c28-969c-407582f1d818'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:50.966764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] The token cache is being invalidate because project 81448a747e9a439aaba595d58c401e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:50.967480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:50.974232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:50.990641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1000/2002] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:50 2022] DELETE /identity/v3/projects/81448a747e9a439aaba595d58c401e3d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:51.003173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:51.038039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f64bd-b464-445a-a713-013ba8e9c093 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:51.166893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:51.169404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:51.177793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:51.199282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:51.200927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:51.201518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:51.202090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] PATH_INFO: `/v3/users/51311f0db84947f9b3a578583fbdc18e` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:51.204451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51311f0db84947f9b3a578583fbdc18e)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:51.208720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:51.294663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3cd13-9ebb-4c28-969c-407582f1d818 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:51.300442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:51.302273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:51.302648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:51.303004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:51.306621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:51.313519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51311f0db84947f9b3a578583fbdc18e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:51.328084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51311f0db84947f9b3a578583fbdc18e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:51.329207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51311f0db84947f9b3a578583fbdc18e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:51.372594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51311f0db84947f9b3a578583fbdc18e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:51.412844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51311f0db84947f9b3a578583fbdc18e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:51.439196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1003/2003] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:51 2022] DELETE /identity/v3/users/51311f0db84947f9b3a578583fbdc18e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:51.443562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:51.450697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b44432-8847-4180-9820-18074c6559d2 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:51.493145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1001/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:52.082825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:52.087958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:52.316383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:52.340360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edf9ff-7375-4398-9246-2ec09958ee8b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:52.356606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:52.358041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.358581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.359056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] PATH_INFO: `/v3/projects/1f51a3c2731a4d35b5519eb3d405717d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.361259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f51a3c2731a4d35b5519eb3d405717d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:52.365355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:52.448594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f51a3c2731a4d35b5519eb3d405717d', 'request_id': 'req-f31f36f9-b1e6-4c4c-8e00-04c796e37787'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.456611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f51a3c2731a4d35b5519eb3d405717d', 'request_id': 'req-f31f36f9-b1e6-4c4c-8e00-04c796e37787'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.464817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f51a3c2731a4d35b5519eb3d405717d', 'request_id': 'req-f31f36f9-b1e6-4c4c-8e00-04c796e37787'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.484219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] The token cache is being invalidate because project 1f51a3c2731a4d35b5519eb3d405717d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:52.484581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.485445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.488199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1004/2005] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:52 2022] DELETE /identity/v3/projects/1f51a3c2731a4d35b5519eb3d405717d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:52.496127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:52.500832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff43b67-aa22-45db-935b-b7c4ba44b731 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.501391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff43b67-aa22-45db-935b-b7c4ba44b731 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.501521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff43b67-aa22-45db-935b-b7c4ba44b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.510939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:52.544200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-dff43b67-aa22-45db-935b-b7c4ba44b731 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:52.545796 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dff43b67-aa22-45db-935b-b7c4ba44b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:52.607030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f36f9-b1e6-4c4c-8e00-04c796e37787 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:52.617459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:52.619443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.620335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.620808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] PATH_INFO: `/v3/users/bb748df66fb34930af20851cf480d680` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.622603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb748df66fb34930af20851cf480d680)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:52.626724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:52.716889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1002/2006] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:52.727431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.728206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb748df66fb34930af20851cf480d680'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.728952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.729534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.741627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb748df66fb34930af20851cf480d680'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.741627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb748df66fb34930af20851cf480d680'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.751046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb748df66fb34930af20851cf480d680'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.772455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:52.774989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:52.786847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-39f7bbf7-3803-49d2-81ca-66d8971649c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb748df66fb34930af20851cf480d680'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:52.790863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1003/2007] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:52.792576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:52.804093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1005/2008] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:52 2022] DELETE /identity/v3/users/bb748df66fb34930af20851cf480d680 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:52.813155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.813475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.813778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.818080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:52.833223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe3a0c-ba32-4679-be13-818315156030 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:52.836773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:52.838160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:52.926429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:52.969345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:52.971246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:52.972169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:52.972341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:52.973649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:52.974349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:52.984709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.014268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1006/2009] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:53.026598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.028344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:53.036220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1004/2010] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:53.050919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.059099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:53.079089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56da6-69fd-48fa-8c50-5211a4ca5511 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.085829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.086852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.087208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.087557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.088305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.090390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.132786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc8001-673e-4a01-8e27-4ed3bb0eeaad None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.137237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.137922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.138240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.138516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.142493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1005/2011] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:53.146810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.158037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.159462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.174547 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1007/2012] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:53.294588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1957-6460-4105-abd8-1296034c93e8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.302279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.303194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.303435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.304383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.305242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.307565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.341983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1006/2013] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:53 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:53.346924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.388999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb110c-cd61-4177-8c8b-a5aca4a43e31 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.404305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.405129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.405473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.405810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.406692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.408973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.425239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1008/2014] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:53.430162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.450145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6408db-024e-4aed-be2f-ce55f5f6b11a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.472388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.473802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.474531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.474929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.475957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.479231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471aa4f2-a2c5-4379-8c0a-dcef3a689709 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.494178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1007/2015] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:53.500721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.519199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847fd79-5b93-4ba4-90c1-0fb61a0cf89a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.534592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.536134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.536882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.537350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] PATH_INFO: `/v3/projects/77e5ab0fb3e24481919485a0e35de688/users/bf3c156d015841bdbc82b0dd5201e503/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.563319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=77e5ab0fb3e24481919485a0e35de688, user_id=bf3c156d015841bdbc82b0dd5201e503, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.568171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:53.609406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1009/2016] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:53 2022] PUT /identity/v3/projects/77e5ab0fb3e24481919485a0e35de688/users/bf3c156d015841bdbc82b0dd5201e503/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:53.623545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.624554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.625038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.686189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] MFA Rules not processed for user `bf3c156d015841bdbc82b0dd5201e503`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:53.687601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:53.849999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1008/2017] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:53.850943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:53.978890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bb7ce-6d9d-43f9-b3cc-53753d0d1bde admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:53.988098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acae14-8404-475f-9834-67171416836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:53.989172 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acae14-8404-475f-9834-67171416836a admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:53.989509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acae14-8404-475f-9834-67171416836a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:53.991522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acae14-8404-475f-9834-67171416836a admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:53.992010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acae14-8404-475f-9834-67171416836a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:53.994416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acae14-8404-475f-9834-67171416836a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.017411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:54.084213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.092409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1010/2018] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:53 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:54.099574 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b489dd9-9e3d-49d1-9b49-0cfae82af506 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.126657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acae14-8404-475f-9834-67171416836a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.132332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f8acae14-8404-475f-9834-67171416836a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:54.224129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:54.276616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acae14-8404-475f-9834-67171416836a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.285384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.286358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.286640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.286979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] PATH_INFO: `/v3/projects/6e11f7e8db02465d9ffcc930ef47abef` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.288420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e11f7e8db02465d9ffcc930ef47abef)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.292066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.303374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.305445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.306186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.306690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.308107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.312240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.346004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1009/2019] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:54 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:54.349434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.371408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e11f7e8db02465d9ffcc930ef47abef', 'request_id': 'req-5e7d0d48-6f36-441f-87bb-561b0796b366'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.373530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0258bd-2bdf-4bbb-a242-d1c5cbefeb35 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.390373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e11f7e8db02465d9ffcc930ef47abef', 'request_id': 'req-5e7d0d48-6f36-441f-87bb-561b0796b366'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.405790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e11f7e8db02465d9ffcc930ef47abef', 'request_id': 'req-5e7d0d48-6f36-441f-87bb-561b0796b366'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.427657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] The token cache is being invalidate because project 6e11f7e8db02465d9ffcc930ef47abef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:54.428148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.428885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.436301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1011/2020] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:54 2022] DELETE /identity/v3/projects/6e11f7e8db02465d9ffcc930ef47abef => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:54.438606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.440336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:54.503052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.504181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.505067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.505433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.507797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.510724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.549414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1010/2021] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:54.556248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.559254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:54.559583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0d48-6f36-441f-87bb-561b0796b366 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.566875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.568144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.568655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.569203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] PATH_INFO: `/v3/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.571431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b8990d296e4b6fb8ad38ca2bdfa7b9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.574934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.587940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cada17-1f96-4164-bd2c-758359727b6a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.598879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.599950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.600480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.601023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.602588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.606030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.627806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:54.630598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1011/2022] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:54.631915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.648770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6624a9-59fd-43d7-b39b-515c0dba1b80 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:54.653186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:54.654581 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.655043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.655467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] PATH_INFO: `/v3/projects/468a9784fa254ca4a6b9b488aa1ce885/users/34bafe75da50411d8cfa646ac8f2c30a/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.675960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b8990d296e4b6fb8ad38ca2bdfa7b9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.687513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=468a9784fa254ca4a6b9b488aa1ce885, user_id=34bafe75da50411d8cfa646ac8f2c30a, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:54.689259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b8990d296e4b6fb8ad38ca2bdfa7b9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.690406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc31c-1c9a-4640-b5a1-b0f2a5248f9c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:54.690967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b8990d296e4b6fb8ad38ca2bdfa7b9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.706551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b8990d296e4b6fb8ad38ca2bdfa7b9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.708121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1012/2023] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:54 2022] PUT /identity/v3/projects/468a9784fa254ca4a6b9b488aa1ce885/users/34bafe75da50411d8cfa646ac8f2c30a/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:54.719222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:54.720066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:54.720147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:54.732147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b8990d296e4b6fb8ad38ca2bdfa7b9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:54.750121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1012/2024] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:54 2022] DELETE /identity/v3/users/e3b8990d296e4b6fb8ad38ca2bdfa7b9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:54.754765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] MFA Rules not processed for user `34bafe75da50411d8cfa646ac8f2c30a`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:54.756667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:54.900992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1013/2025] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:54.905747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:54.907687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:55.070700 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622abaa9-399e-47bf-bff0-e8b0d2d32bc6 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.077803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.079869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.079869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.080167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.081324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.084267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.149053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1013/2026] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:54 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:55.159180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.174885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62ba5f-c979-4426-bedd-1ad1249809c4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.191230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:55.320316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.328379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:55.368453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.373579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.374038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.374431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.375296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.378237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.415758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1014/2027] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:55 2022] POST /identity/v3/users => generated 295 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:55.417166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.434936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefcb6c-fd07-4335-8ad3-bc8e611d79e3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.441820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.443035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.443342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.443727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.444735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.446980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.468775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1015/2028] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:55.470298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.499085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4f408-fd22-4253-8551-97a96f180e20 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.514112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.517487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.518116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.519431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] PATH_INFO: `/v3/projects/f55a5dad574e4c8593563509570ecde1/users/86ea85741a2b46f193272aa372744f68/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.557631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55a5dad574e4c8593563509570ecde1, user_id=86ea85741a2b46f193272aa372744f68, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.560709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.591305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1016/2029] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:55 2022] PUT /identity/v3/projects/f55a5dad574e4c8593563509570ecde1/users/86ea85741a2b46f193272aa372744f68/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:55.592666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229183b0-b96d-47e5-ac44-6e48abcfe288 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.598036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.662710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:55.715966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.717705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.718332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.718797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] PATH_INFO: `/v3/projects/c641749539ca4b9ebed55dcfa160c931` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.721190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c641749539ca4b9ebed55dcfa160c931)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.721409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b4a08-2062-4843-80db-e56e9c01cd5e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.725036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.727351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.728262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.728613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.728962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.730051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.732478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.748778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1017/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:55.750100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:55.763899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f62ff-8100-4674-a55f-b8f4b9150323 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:55.779094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:55.781613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.781874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.782993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] PATH_INFO: `/v3/projects/f55a5dad574e4c8593563509570ecde1/users/86ea85741a2b46f193272aa372744f68/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.786780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55a5dad574e4c8593563509570ecde1, user_id=86ea85741a2b46f193272aa372744f68, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:55.789787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dd993-6b2a-4f36-a26b-9c00310ff666 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:55.806254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1018/2031] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:55 2022] PUT /identity/v3/projects/f55a5dad574e4c8593563509570ecde1/users/86ea85741a2b46f193272aa372744f68/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:55.818304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.818864 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.819236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.826759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c641749539ca4b9ebed55dcfa160c931', 'request_id': 'req-8da8ad9b-2180-48d5-8322-a63264c8ccbd'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:55.838831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c641749539ca4b9ebed55dcfa160c931', 'request_id': 'req-8da8ad9b-2180-48d5-8322-a63264c8ccbd'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:55.848557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c641749539ca4b9ebed55dcfa160c931', 'request_id': 'req-8da8ad9b-2180-48d5-8322-a63264c8ccbd'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:55.855125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] MFA Rules not processed for user `86ea85741a2b46f193272aa372744f68`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:55.856413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:55.874359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] The token cache is being invalidate because project c641749539ca4b9ebed55dcfa160c931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:55.874879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:55.875977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8da8ad9b-2180-48d5-8322-a63264c8ccbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:55.878786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1014/2032] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:55 2022] DELETE /identity/v3/projects/c641749539ca4b9ebed55dcfa160c931 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:55.886247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a31c-3dfc-4fc9-881f-e1a24deca6d0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:55.886810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a31c-3dfc-4fc9-881f-e1a24deca6d0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:55.887265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a31c-3dfc-4fc9-881f-e1a24deca6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:55.941964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5736a31c-3dfc-4fc9-881f-e1a24deca6d0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:55.944149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5736a31c-3dfc-4fc9-881f-e1a24deca6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:55.956385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:56.007554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1019/2033] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:56.019882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.021394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.034638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1015/2034] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:56.047418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.047974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.048436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.076751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:56.078911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.091052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1016/2035] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:56.096407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.108795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fec729-ab62-4649-9438-7fe2ca1e8fae None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.109147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90ba85-e044-4602-9956-0fe21db77ab1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.112959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.113810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.114238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.114576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.115083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.115874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.116265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.116648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.117849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:56.118498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.121378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.127498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.130680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.136035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1017/2036] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:47:56.140672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.146637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1020/2037] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:56.151953 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea086eb-86c1-43c5-834c-8b7512a3b808 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.157378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.158188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.158478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.158755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.159467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.161402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.198638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1018/2038] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:56 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:56.206943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.216156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.218089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.219897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b19a84-ef48-4c75-b28f-9864972289d7 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.252790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:56.301867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f354760-8f7c-436e-a8ca-21d489147e72 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.306783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.307478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.307762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.308039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.309906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.310146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.311561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.312169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.312642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.313889 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.318085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.350235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1021/2039] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:56 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:56.355074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.366731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b39592-c5b7-48fb-948f-8004cd7903fe admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.372314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.373054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.373349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.373593 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.374391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.376153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.388379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1022/2040] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:56.393275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.404887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.406497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.416912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bfec7-74c7-49bb-9b84-e5232024e134 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.419003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1019/2041] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:56.422883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.423580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.423865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.424311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.425226 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.426763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9e7ec-d1b0-43c8-9da5-1f056148e6b3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.439476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1023/2042] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:56.444291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.460940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00b32-5b41-4267-b6b7-39adfd3195e0 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.466753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.467706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.467984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.468259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] PATH_INFO: `/v3/projects/bbbeaadef70b405daad56bb65e36ac74/users/5da9291048b04b05b3899782ba91f95e/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.489394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbeaadef70b405daad56bb65e36ac74, user_id=5da9291048b04b05b3899782ba91f95e, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.493370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.512111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1020/2043] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:56 2022] PUT /identity/v3/projects/bbbeaadef70b405daad56bb65e36ac74/users/5da9291048b04b05b3899782ba91f95e/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:56.530335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.530335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.530335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.572821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] MFA Rules not processed for user `5da9291048b04b05b3899782ba91f95e`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:56.574128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.628174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:56.699842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.702369 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:56.706061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1024/2044] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:56.724778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:56.920473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d469-37d7-4b19-b1b3-4e8ffdeab0b2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.926180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef9622-9f2c-48ac-9e13-7cfd86ad8207 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:56.937129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.938008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:56.939022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.939452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.939891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.940064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:56.941004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:56.942238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] PATH_INFO: `/v3/users/e47ff0e3e031446f805e5a9718181a0c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:56.954749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.955387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47ff0e3e031446f805e5a9718181a0c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:56.957531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.958110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:56.976845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1025/2045] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:57.022391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:57.056210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b94e0a-ed3c-4d4b-8887-f34c8769cc83 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:57.076036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:57.077449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:57.078056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:57.078570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] PATH_INFO: `/v3/users/5da9291048b04b05b3899782ba91f95e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:57.087399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da9291048b04b05b3899782ba91f95e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:57.095395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:57.108387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47ff0e3e031446f805e5a9718181a0c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.139748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47ff0e3e031446f805e5a9718181a0c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.143461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47ff0e3e031446f805e5a9718181a0c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.152347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:57.165728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47ff0e3e031446f805e5a9718181a0c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.196814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b5909e5b-e82d-4ca8-a925-20d7ed38e951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47ff0e3e031446f805e5a9718181a0c'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.229316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1021/2046] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:56 2022] DELETE /identity/v3/users/e47ff0e3e031446f805e5a9718181a0c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:47:57.230425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da9291048b04b05b3899782ba91f95e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.231204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da9291048b04b05b3899782ba91f95e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.231919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da9291048b04b05b3899782ba91f95e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.234419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:57.234974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:57.235192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:57.252576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da9291048b04b05b3899782ba91f95e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.257008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:57.258433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:57.263019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a4a9f1ce-f26d-47b6-850f-8fb677988d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da9291048b04b05b3899782ba91f95e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:57.292957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1026/2047] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:47:57 2022] DELETE /identity/v3/users/5da9291048b04b05b3899782ba91f95e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:57.300443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:57.300890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:57.301335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:57.324539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:57.325697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:57.329333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1022/2048] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:57.341694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:57.343577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:57.389513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:57.415804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1027/2049] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:57.425966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f719cfc-b0b8-40f0-9dfa-a3016033aa20 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:57.427396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:57.429074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:57.499743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:57.501304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:57.502055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:57.502674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b8ee-6407-4e7f-92dd-81636882fa53 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:57.502876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:57.507000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:57.507688 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:57.508025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:57.508732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:57.526999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:57.529170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:57.532919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:57.535766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bba99-d6ca-46c2-8ab5-9cfd1a438edd service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:57.542305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1023/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:47:57.556561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1028/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:58.012482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:58.016664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:58.053286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701dca6-612e-4c9d-a17a-09a33d3214b4 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:58.070174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:58.073348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.073816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.074422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] PATH_INFO: `/v3/projects/bbbeaadef70b405daad56bb65e36ac74` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.077477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbeaadef70b405daad56bb65e36ac74)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:58.082991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:58.164578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=1,keystone:DELETE=5,keystone:SELECT=94 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:58.260114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbeaadef70b405daad56bb65e36ac74', 'request_id': 'req-93524dd0-f23a-4fe5-980e-d4f4567bdf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.279445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbeaadef70b405daad56bb65e36ac74', 'request_id': 'req-93524dd0-f23a-4fe5-980e-d4f4567bdf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.294439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbeaadef70b405daad56bb65e36ac74', 'request_id': 'req-93524dd0-f23a-4fe5-980e-d4f4567bdf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.327491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] The token cache is being invalidate because project bbbeaadef70b405daad56bb65e36ac74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:58.327491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.331610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-93524dd0-f23a-4fe5-980e-d4f4567bdf21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.336803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1024/2052] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:58 2022] DELETE /identity/v3/projects/bbbeaadef70b405daad56bb65e36ac74 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:58.345620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.347764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.348235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.384091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:58.386351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:58.562177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1029/2053] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:58.578012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.578867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.578867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.606780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:58.608101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:58.617547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:58.621354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:58.630014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1025/2054] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:58.644810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:58.659678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9a61f-138a-4593-b2e9-8b833d8bd8f6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:58.668373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:58.670189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.670771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cb72c-72fc-419d-9b0c-8ad3e115341a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:58.670888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.680859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:58.681934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.682495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.683048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.687315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:58.687671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:58.691069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:58.699276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] PATH_INFO: `/v3/projects/6f67938ad67c46fc802c1d1e03f935fe` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.710406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f67938ad67c46fc802c1d1e03f935fe)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:58.721280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:58.734634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1026/2055] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:58.741130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:58.756099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2113-cbfa-467f-98a5-778d44f07056 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:58.774691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:58.775470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.776701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.776701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.777284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:58.779621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:58.849989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1027/2056] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:58 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:58.855235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:58.872045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f67938ad67c46fc802c1d1e03f935fe', 'request_id': 'req-7a2453c6-1811-4583-bb19-a94bc4202a9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.890660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f67938ad67c46fc802c1d1e03f935fe', 'request_id': 'req-7a2453c6-1811-4583-bb19-a94bc4202a9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.906687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f67938ad67c46fc802c1d1e03f935fe', 'request_id': 'req-7a2453c6-1811-4583-bb19-a94bc4202a9d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.934584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] The token cache is being invalidate because project 6f67938ad67c46fc802c1d1e03f935fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:47:58.935088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.937159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a2453c6-1811-4583-bb19-a94bc4202a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:47:58.947216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1030/2057] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:47:58 2022] DELETE /identity/v3/projects/6f67938ad67c46fc802c1d1e03f935fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:58.949752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c869e-99de-40f1-b6f3-4492a3f6e5d4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.950289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c869e-99de-40f1-b6f3-4492a3f6e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.950774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c869e-99de-40f1-b6f3-4492a3f6e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.979495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317fd9-1985-4044-8c33-10fe34f1d64a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:58.987889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:58.990056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:58.990592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:58.991248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:58.994243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:58.994716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.003401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a14c869e-99de-40f1-b6f3-4492a3f6e5d4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:59.005402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a14c869e-99de-40f1-b6f3-4492a3f6e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:59.046020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1028/2058] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:58 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:47:59.051301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.053050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1031/2059] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:47:59.055635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:59.063790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.064348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.064818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.087790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:59.090419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:59.100493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1032/2060] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:59.105418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.107510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd7dc0-cbb7-43fe-a0bb-fa0b8def6f4e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.111254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:59.123495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.124647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.125097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.125705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.127038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.133908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.144749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9adda-0ff6-4e3b-9e84-4a3e3c89b70b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.159711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.160815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.161102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.161977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.162514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:47:59.163057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.165140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.166809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1029/2061] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:59.170246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.188657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1033/2062] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:47:59.197147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.203722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8d65-1ed0-4b38-9fb8-e24aa971c0e5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.213555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.214660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.215036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.215462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.217286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.219787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.221238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24462204-a903-4b20-b5a8-f8664ddbbaa9 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.233786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.234611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.234893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.235172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.235977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.238318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.260357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1030/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:47:59.275130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.308139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83191d91-3646-4cbb-bff0-c0eac0895d57 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.317353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.319453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.320080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.320756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] PATH_INFO: `/v3/projects/7f7b1e6f582344928572dc058d2fc509/users/0bfd7c9ba3d34bc1b2268ba4ac30cc84/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.324266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1034/2064] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:47:59 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:59.327064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.363580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7b1e6f582344928572dc058d2fc509, user_id=0bfd7c9ba3d34bc1b2268ba4ac30cc84, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.366970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496262-9421-47fd-be01-d1a3a7d75341 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.391637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1031/2065] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:59 2022] PUT /identity/v3/projects/7f7b1e6f582344928572dc058d2fc509/users/0bfd7c9ba3d34bc1b2268ba4ac30cc84/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:47:59.405914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.406520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.407359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.458067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] MFA Rules not processed for user `0bfd7c9ba3d34bc1b2268ba4ac30cc84`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:47:59.460045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:59.466200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605999b-30bd-4cb2-8be3-5d4480b4a0e8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.472863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:47:59.594026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1032/2066] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:47:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:47:59.611602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.611880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.613030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.613618 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.614331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.615912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.616110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:47:59.620654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.697248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1035/2067] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:47:59 2022] POST /identity/v3/users => generated 296 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:47:59.703543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.742108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb618d3-2292-43d4-9d1a-c68cc726b242 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.754362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.757299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.758549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.759369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.761434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.765137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.794477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979c27-053a-49fd-b247-1be6c69a92df None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.812885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1036/2068] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:59.820686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.822027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.822553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.826026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.829519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.846071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.848373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.860488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c24ba9-35d6-4ffa-bf83-cfca5a7d7587 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.876353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1033/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:47:59.876663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.878244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.878596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.879066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.879973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.882069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7232d32-993d-45d4-83e9-2f6633ab086f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:47:59.910378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1037/2070] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:47:59.914906 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:47:59.952234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7b3e9-bd2b-4201-b0cc-d55ea6437edd service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:47:59.961297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:47:59.963431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:47:59.963896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:47:59.964404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] PATH_INFO: `/v3/projects/d1b2fea0028d4942a57d9198af688f41/users/d7a1bbffff5e45d5ba33534afa45c57c/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:47:59.989024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b2fea0028d4942a57d9198af688f41, user_id=d7a1bbffff5e45d5ba33534afa45c57c, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:47:59.993833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:00.018492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1034/2071] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:47:59 2022] PUT /identity/v3/projects/d1b2fea0028d4942a57d9198af688f41/users/d7a1bbffff5e45d5ba33534afa45c57c/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:00.033046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:00.033894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:00.038443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:00.080311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] MFA Rules not processed for user `d7a1bbffff5e45d5ba33534afa45c57c`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:00.082682 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:00.159856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:00.239083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1038/2072] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:00.253260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:00.257017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:00.344212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:00.345702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:00.432417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ab93-a64c-4eaf-b8af-a8954b11e71c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:00.442223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:00.444768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:00.446062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:00.446803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:00.470875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:00.490011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d142e9b-1c03-4dd1-9e64-584767e75c7d service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:00.515523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1035/2073] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:00.543144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b678e-94b6-421e-b780-e867c6bceb11 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:00.570105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:00.572169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:00.572767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:00.573378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] PATH_INFO: `/v3/users/bf3c156d015841bdbc82b0dd5201e503` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:00.575938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3c156d015841bdbc82b0dd5201e503)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:00.580038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:00.679127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3c156d015841bdbc82b0dd5201e503'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:00.679695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3c156d015841bdbc82b0dd5201e503'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:00.680772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3c156d015841bdbc82b0dd5201e503'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:00.700107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3c156d015841bdbc82b0dd5201e503'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:00.712194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3c156d015841bdbc82b0dd5201e503'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:00.745126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1039/2074] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:00 2022] DELETE /identity/v3/users/bf3c156d015841bdbc82b0dd5201e503 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:00.752743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:00.754032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:00.754461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:00.787037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:00.789146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:00.838343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:00.920194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1036/2075] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:00.932876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:00.935476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:01.117251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cefa24-1fc8-4e29-b35e-7b7897d35498 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:01.138736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:01.139895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:01.140372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:01.140918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:01.174443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:01.182500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:01.186607 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:01.204629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1040/2076] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:01.841521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:01.844618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:01.874895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5675dc2-a23b-4d8a-a93b-1cdea742f572 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:01.911977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:01.913074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:01.913510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:01.913933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] PATH_INFO: `/v3/projects/77e5ab0fb3e24481919485a0e35de688` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:01.916297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=77e5ab0fb3e24481919485a0e35de688)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:01.919604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:01.996166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e5ab0fb3e24481919485a0e35de688', 'request_id': 'req-a0557efb-d52e-476d-b5f1-62a807e87c3a'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.003905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e5ab0fb3e24481919485a0e35de688', 'request_id': 'req-a0557efb-d52e-476d-b5f1-62a807e87c3a'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.014006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e5ab0fb3e24481919485a0e35de688', 'request_id': 'req-a0557efb-d52e-476d-b5f1-62a807e87c3a'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.036634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] The token cache is being invalidate because project 77e5ab0fb3e24481919485a0e35de688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:02.037166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.038244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.041039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1037/2077] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:01 2022] DELETE /identity/v3/projects/77e5ab0fb3e24481919485a0e35de688 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:02.046400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:02.062505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aee70b-a99c-4cea-bf5d-a18c609e4a75 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:02.141816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:02.142814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:02.143097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:02.143379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] PATH_INFO: `/v3/users/34bafe75da50411d8cfa646ac8f2c30a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:02.144850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34bafe75da50411d8cfa646ac8f2c30a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:02.146897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:02.236993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34bafe75da50411d8cfa646ac8f2c30a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.237839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34bafe75da50411d8cfa646ac8f2c30a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.238670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34bafe75da50411d8cfa646ac8f2c30a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.248563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34bafe75da50411d8cfa646ac8f2c30a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.260512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34bafe75da50411d8cfa646ac8f2c30a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:02.286922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1041/2078] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:02 2022] DELETE /identity/v3/users/34bafe75da50411d8cfa646ac8f2c30a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:02.934277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:02.936642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:02.967710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0557efb-d52e-476d-b5f1-62a807e87c3a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:03.082166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:03.083070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:03.083255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:03.083536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] PATH_INFO: `/v3/projects/468a9784fa254ca4a6b9b488aa1ce885` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:03.085433 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468a9784fa254ca4a6b9b488aa1ce885)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:03.088113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:03.174961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468a9784fa254ca4a6b9b488aa1ce885', 'request_id': 'req-49c24c45-47b4-4b64-950b-a837fb5b9581'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.183927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:03.186794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468a9784fa254ca4a6b9b488aa1ce885', 'request_id': 'req-49c24c45-47b4-4b64-950b-a837fb5b9581'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.201418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468a9784fa254ca4a6b9b488aa1ce885', 'request_id': 'req-49c24c45-47b4-4b64-950b-a837fb5b9581'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.239712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] The token cache is being invalidate because project 468a9784fa254ca4a6b9b488aa1ce885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:03.240280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.241465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.245638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1038/2079] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:02 2022] DELETE /identity/v3/projects/468a9784fa254ca4a6b9b488aa1ce885 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:03.249690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:03.251929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:03.292238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ac748-61f2-47c3-b05b-55cc4e772edb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:03.389179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:03.390914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:03.391421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:03.391914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] PATH_INFO: `/v3/users/86ea85741a2b46f193272aa372744f68` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:03.394132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ea85741a2b46f193272aa372744f68)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:03.398041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:03.421811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:03.489394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ea85741a2b46f193272aa372744f68'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.490455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ea85741a2b46f193272aa372744f68'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.491381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ea85741a2b46f193272aa372744f68'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.501704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ea85741a2b46f193272aa372744f68'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.513779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-df99973b-3249-4365-870f-aebcd0a7d129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ea85741a2b46f193272aa372744f68'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:03.546223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1042/2080] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:03 2022] DELETE /identity/v3/users/86ea85741a2b46f193272aa372744f68 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:04.155329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:04.158021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:04.213685 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c24c45-47b4-4b64-950b-a837fb5b9581 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:04.319836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:04.321973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.322741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.323237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] PATH_INFO: `/v3/projects/f55a5dad574e4c8593563509570ecde1` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.326267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55a5dad574e4c8593563509570ecde1)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:04.330431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:04.419565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55a5dad574e4c8593563509570ecde1', 'request_id': 'req-b22816c8-9ab6-49a2-bd72-06d95e18de1e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:04.428029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55a5dad574e4c8593563509570ecde1', 'request_id': 'req-b22816c8-9ab6-49a2-bd72-06d95e18de1e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:04.440078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55a5dad574e4c8593563509570ecde1', 'request_id': 'req-b22816c8-9ab6-49a2-bd72-06d95e18de1e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:04.469633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] The token cache is being invalidate because project f55a5dad574e4c8593563509570ecde1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:04.470230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:04.471413 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b22816c8-9ab6-49a2-bd72-06d95e18de1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:04.482881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1039/2081] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:04 2022] DELETE /identity/v3/projects/f55a5dad574e4c8593563509570ecde1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:04.485465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.486299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.486299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.517529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:04.520261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:04.651879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1043/2082] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:04.662219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.662752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.663216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.690183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:04.691490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:04.700557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1040/2083] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:04.707551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:04.726159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c451da7-834e-49da-a224-b09fc43c081e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:04.734951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:04.735781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.736204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.736768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.737609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:04.738108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:04.740373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:04.759349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1044/2084] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:04.766777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:04.787198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b85925-731e-4a0c-951e-8355f0ef4e52 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:04.796064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:04.797347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.797929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.798519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.799900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:04.802467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:04.849388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1041/2085] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:04 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:04.856388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:04.877387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb89197-957c-40c9-8f32-b0c792a62a8b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:04.973196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:04.974089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:04.974275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:04.974525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:04.975372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:04.977669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:05.009092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1045/2086] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:04 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:05.011327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:05.043585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520e32f-ae2f-4ebe-bcba-acfc17092c7b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:05.055833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:05.057262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:05.057779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:05.058148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:05.059068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:05.061015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:05.082977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1042/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:05.084592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:05.099690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f3dea-8f86-415d-8b69-ddf130ed4fac admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:05.105326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:05.106390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:05.106833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:05.107303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:05.108223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:05.110432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93344e-0c9c-4d79-b60e-1eef5edeb8a9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:05.117124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:05.134461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:05.144913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1046/2088] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:05.148725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a77a47-08e4-42ab-aece-a51c21d975c6 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:05.158181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:05.159270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:05.159786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:05.160211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] PATH_INFO: `/v3/projects/0a2be5bcecb342acafacdf5bb6d00bd0/users/39cf6fe7b4b6420da1aba08386b72168/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:05.190512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2be5bcecb342acafacdf5bb6d00bd0, user_id=39cf6fe7b4b6420da1aba08386b72168, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:05.194717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:05.224681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1043/2089] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:05 2022] PUT /identity/v3/projects/0a2be5bcecb342acafacdf5bb6d00bd0/users/39cf6fe7b4b6420da1aba08386b72168/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:05.229624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdaa27-5fcc-4ce2-82e6-cb1c75892560 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:05.229924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdaa27-5fcc-4ce2-82e6-cb1c75892560 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:05.230322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdaa27-5fcc-4ce2-82e6-cb1c75892560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:05.260494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b7cdaa27-5fcc-4ce2-82e6-cb1c75892560 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:05.262258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b7cdaa27-5fcc-4ce2-82e6-cb1c75892560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:05.422880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1047/2090] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:05.438989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:05.441484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:05.467406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:05.557109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b45e8-7def-4b1c-b1bb-189f9ee77fa4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:05.566174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:05.566866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:05.567157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:05.567435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:05.578243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:05.579750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:05.600638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1044/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:07.887712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:07.888514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:07.888514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:07.928365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] MFA Rules not processed for user `39cf6fe7b4b6420da1aba08386b72168`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:07.929823 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:08.066976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1048/2092] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:08.068837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.087909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79739d8-10ca-4869-b13b-540e8d8c8d71 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.097423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.098573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.099062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.099677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.100900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.105059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.154536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1045/2093] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:08.158691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.175076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda4a6-31b0-4b5e-9f47-c3ae79340fc2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.279893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.280579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.280852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.281115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.282250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.284498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.313736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1049/2094] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:08 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:08.317788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.334235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce365264-4e21-4028-a9e9-ad6b63afd258 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.342313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.343077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.343356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.343633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.344370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.346165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.359566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1046/2095] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:08.364764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.378715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52974696-64a5-4c8d-9d9c-cd556efabe19 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.384066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.385285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.385569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.385840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] PATH_INFO: `/v3/projects/852d4cd9f5d9465b890d9d385f9676f4/users/1fdbd6dcbe184b47ac15ab2090926a36/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.408606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d4cd9f5d9465b890d9d385f9676f4, user_id=1fdbd6dcbe184b47ac15ab2090926a36, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.411601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.414466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:08.429895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1050/2096] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:08 2022] PUT /identity/v3/projects/852d4cd9f5d9465b890d9d385f9676f4/users/1fdbd6dcbe184b47ac15ab2090926a36/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:08.434575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.448153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daedcf-4d7a-43e6-b54d-56c5ad726d59 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.546529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.548042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.548540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.549067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.550384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.553213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e6eba-ae67-4760-a335-c6d6ed0a53f1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.568597 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1047/2097] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:08.573653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:08.595529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36883ad-3f6b-450d-b65f-ccd6206a3f6f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:08.605132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:08.606415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:08.608795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:08.609617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] PATH_INFO: `/v3/projects/852d4cd9f5d9465b890d9d385f9676f4/users/1fdbd6dcbe184b47ac15ab2090926a36/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:08.613140 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d4cd9f5d9465b890d9d385f9676f4, user_id=1fdbd6dcbe184b47ac15ab2090926a36, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:08.616741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b78f-039b-4967-97f3-204441ad81b8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:08.634560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1051/2098] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:08 2022] PUT /identity/v3/projects/852d4cd9f5d9465b890d9d385f9676f4/users/1fdbd6dcbe184b47ac15ab2090926a36/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:10.395418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376d57-8c4a-4746-b33b-7a4ea865a650 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:10.395995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376d57-8c4a-4746-b33b-7a4ea865a650 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:10.395995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67376d57-8c4a-4746-b33b-7a4ea865a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:10.479996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-67376d57-8c4a-4746-b33b-7a4ea865a650 None None] MFA Rules not processed for user `1fdbd6dcbe184b47ac15ab2090926a36`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:10.481517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-67376d57-8c4a-4746-b33b-7a4ea865a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:10.667275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:10.671837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1048/2099] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:10.683232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:10.684018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:10.684018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:10.694206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab317-5ee6-47a8-ada0-59f647be1b35 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:10.694206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab317-5ee6-47a8-ada0-59f647be1b35 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:10.694577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab317-5ee6-47a8-ada0-59f647be1b35 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:10.696593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1049/2100] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:48:10.711684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:10.712116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:10.712426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:10.722376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] MFA Rules not processed for user `39cf6fe7b4b6420da1aba08386b72168`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:10.724977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:10.763329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] MFA Rules not processed for user `266fca3c917546fa8de7b25c77c5fd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:10.764857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:10.810170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1052/2101] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:10.823438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:10.827404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:10.890775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1050/2102] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:48:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:10.891765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:10.893241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:10.957149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639e46d-c06c-45d8-9802-9fa7d9a64f0c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:10.962614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:10.963526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:10.963812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:10.964660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:10.974519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:10.976441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:10.997230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1053/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:10.998649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:10.998987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaf4fd-a91c-4eb2-935f-2f672d5f6c8f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:11.001091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:11.010039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:11.011332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:11.012075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:11.012717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] PATH_INFO: `/v3/users/716d438ebbcb49069bf9fe416559c846` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:11.014350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=716d438ebbcb49069bf9fe416559c846)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:11.016909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:11.019435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323340b-33cd-40d7-bda8-fdc8d4aa2b0d service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:11.028746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:11.029848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:11.034984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:11.035504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:11.056362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:11.059527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:11.079824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1054/2104] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:11.124808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716d438ebbcb49069bf9fe416559c846'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.139301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716d438ebbcb49069bf9fe416559c846'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.140583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716d438ebbcb49069bf9fe416559c846'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.154161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716d438ebbcb49069bf9fe416559c846'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.173631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-7eab16bb-81f3-4b0a-9abb-11bee37a8c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716d438ebbcb49069bf9fe416559c846'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.183724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1051/2105] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:10 2022] DELETE /identity/v3/users/716d438ebbcb49069bf9fe416559c846 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:11.414197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:11.442683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57593e-d443-4dca-812a-07d8f2275fd9 service placement] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:11.562521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:11.572443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:11.573917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:11.574434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:11.574872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] PATH_INFO: `/v3/projects/de4e5238665642e48fbdf416791fea1c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:11.576577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4e5238665642e48fbdf416791fea1c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:11.578888 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:11.674420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4e5238665642e48fbdf416791fea1c', 'request_id': 'req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.683328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4e5238665642e48fbdf416791fea1c', 'request_id': 'req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.690943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4e5238665642e48fbdf416791fea1c', 'request_id': 'req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.718465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] The token cache is being invalidate because project de4e5238665642e48fbdf416791fea1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:11.718761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.720355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f20a2efa-8fe1-467e-be4c-8cdf3d0b4023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:11.725987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1055/2106] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:11 2022] DELETE /identity/v3/projects/de4e5238665642e48fbdf416791fea1c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:11.733449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:11.734220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:11.734479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:11.806880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:11.810184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:11.832828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:11.944989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1052/2107] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:11.957523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:11.957865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:11.958199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:11.981742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:11.983133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:11.993137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1056/2108] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:11.999784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.014117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8bc2d-7ce5-4e04-acb4-2e0567c92ea2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.020624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.021374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.021656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.022210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.022704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:12.023174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.025064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.046226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1053/2109] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:12.047529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.059476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594b281-7978-4cd2-856e-0f16faf5edcc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.064655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.065336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.065616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.065891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.066800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.068633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.101962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1057/2110] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:12 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:12.109630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.121252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2efd61-424b-40a8-b720-87b23bcd1316 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.198059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.198823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.199060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.199335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.201255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.208096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.246672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1054/2111] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:12 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:12.252664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.266045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315484dc-d2a3-489e-b55e-f2d3d4a31141 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.271317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.272025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.272331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.272623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.273918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.276037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.289542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1058/2112] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:48:12.295028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.306712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab17a8-99ef-4b6a-9e54-eb8599730854 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.312987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.313695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.314046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.314283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.315031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.328345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3aed4-57a9-4aa1-b779-1830641759ca admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.333843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1055/2113] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:12.342728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.356496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944f88-c173-4b4c-b1c4-58a3250a9933 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.363307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.364850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.365334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.365816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] PATH_INFO: `/v3/projects/4f04f809edd840e6b34c9ed1f62293d8/users/5250626930844a86b9249eef6c1c9372/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.396945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f04f809edd840e6b34c9ed1f62293d8, user_id=5250626930844a86b9249eef6c1c9372, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.401919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.422732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1059/2114] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:12 2022] PUT /identity/v3/projects/4f04f809edd840e6b34c9ed1f62293d8/users/5250626930844a86b9249eef6c1c9372/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:12.435588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.436228 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.436671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.487336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] MFA Rules not processed for user `5250626930844a86b9249eef6c1c9372`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:12.488586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:12.589887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1056/2115] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:12.593405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.704728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763c436-b9c2-40c3-80bf-719206a4dd20 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.718120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.719683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.720717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.721434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.723157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.727287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:12.801194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1060/2116] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:12 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:12.808881 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.832119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7178770-eaae-46bd-a98c-bc125ac0d337 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:12.848525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:12.889258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:12.894806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:12.944585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:12.973394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:12.975270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:12.975561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:12.975842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:12.981028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:12.993931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.032599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1057/2117] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:12 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:13.039787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.057802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f2346-5d7c-4064-94a2-12f4f8ff13bb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.065793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.066886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.067331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.067725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] PATH_INFO: `/v3/users/d7a1bbffff5e45d5ba33534afa45c57c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.070161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a1bbffff5e45d5ba33534afa45c57c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.071094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1330d-8bda-44f8-9004-f31e875cf2c7 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.072705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.089213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.090519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.092298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.092831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.103995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.105674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.125670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1058/2118] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:13.131244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.148385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845139b5-3101-4434-b995-b814fdb16a01 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.157988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.158968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.159247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.159555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] PATH_INFO: `/v3/projects/af8d67a4519040e998d86c2f9f0df976/users/7b03a91910a347b7993d370e8e5778e8/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.178199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a1bbffff5e45d5ba33534afa45c57c'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:13.179532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a1bbffff5e45d5ba33534afa45c57c'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:13.180883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a1bbffff5e45d5ba33534afa45c57c'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:13.188997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d67a4519040e998d86c2f9f0df976, user_id=7b03a91910a347b7993d370e8e5778e8, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.195240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.196694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a1bbffff5e45d5ba33534afa45c57c'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:13.210490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d36baba7-4241-4d1f-9049-1e1f7263fb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a1bbffff5e45d5ba33534afa45c57c'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:13.220246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1059/2119] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:13 2022] PUT /identity/v3/projects/af8d67a4519040e998d86c2f9f0df976/users/7b03a91910a347b7993d370e8e5778e8/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:13.224322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.226397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:13.238531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1061/2120] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:12 2022] DELETE /identity/v3/users/d7a1bbffff5e45d5ba33534afa45c57c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:13.243199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.243496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.243773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.274441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:13.277120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:13.332470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9a961-6b34-4070-9a0a-25d43f3d1acc admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.382274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1062/2121] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:13.393885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.395444 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:13.481392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:13.543043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.543806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.544213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.544442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.545127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.545982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ece992-b331-4150-941c-95300f68ffcb None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.547030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.561885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.562741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.563027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.565545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.569063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1060/2122] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:13.576610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.580817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.582447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749063e-fe3e-40bf-bae8-f5ef6e3f6d83 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.593029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384659-053f-472b-b6a6-84efdc58536a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.598141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1063/2123] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:13.607899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.608837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.609124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.609407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] PATH_INFO: `/v3/projects/af8d67a4519040e998d86c2f9f0df976/users/7b03a91910a347b7993d370e8e5778e8/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.611775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d67a4519040e998d86c2f9f0df976, user_id=7b03a91910a347b7993d370e8e5778e8, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.614644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:13.632690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:13.656007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1061/2124] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:13 2022] PUT /identity/v3/projects/af8d67a4519040e998d86c2f9f0df976/users/7b03a91910a347b7993d370e8e5778e8/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:13.671162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.671162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.671162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.714787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] MFA Rules not processed for user `7b03a91910a347b7993d370e8e5778e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:13.716966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:13.854207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1064/2125] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:13.865106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:13.868062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:13.955506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8464c-ee48-4c71-afed-fcd04a01fc01 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:13.961865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:13.962904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:13.963434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:13.963884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:13.980580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:13.983322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.004552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1062/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:14.060886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.063649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:14.174140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.195414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d5be8-477a-49d5-8a18-ef4ec207e34d service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:14.201971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:14.203266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.204674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.204674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.207798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:14.225585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c974ae4-f8cb-4185-9213-a27fa5ab9b25 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:14.234393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:14.236017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.236431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.236793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] PATH_INFO: `/v3/projects/d1b2fea0028d4942a57d9198af688f41` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.239346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b2fea0028d4942a57d9198af688f41)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:14.243152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.350527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b2fea0028d4942a57d9198af688f41', 'request_id': 'req-c8a80317-2807-4fee-ac23-565e69fa5ef2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:14.363403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b2fea0028d4942a57d9198af688f41', 'request_id': 'req-c8a80317-2807-4fee-ac23-565e69fa5ef2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:14.365969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:14.371432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:14.374420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c5816-e40a-472c-a516-d597cdc5710c service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.383220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b2fea0028d4942a57d9198af688f41', 'request_id': 'req-c8a80317-2807-4fee-ac23-565e69fa5ef2'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:14.394571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1063/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:14.412065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] The token cache is being invalidate because project d1b2fea0028d4942a57d9198af688f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:14.412600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:14.415365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c8a80317-2807-4fee-ac23-565e69fa5ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:14.420215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1065/2128] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:14 2022] DELETE /identity/v3/projects/d1b2fea0028d4942a57d9198af688f41 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:14.427893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.428531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.429814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.460140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:14.462435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:14.658618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1064/2129] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:14.668350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.668700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.668873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.706641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:14.710737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:14.737802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1066/2130] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:14.742359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.754652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965b357-941f-4b1b-b6f1-7fe8d66d4258 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:14.761258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:14.762226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.762591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.762941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.764899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:14.765288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:14.767190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.783761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1065/2131] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:14.788997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.807301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370d1e-ab49-4def-82d0-43390626df92 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:14.817982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:14.819174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.819640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.820471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.821848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:14.825129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.866272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.881872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1067/2132] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:14 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:14.884048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da67d6-a0ac-49b6-9b68-9b2eea8a751c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:14.912528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:14.914942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:14.917543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:14.968124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:14.968879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:14.969322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:14.969727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:14.971289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:14.974339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:14.999190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece12eb-b7d4-4fff-985e-c6f6deb15093 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.005605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.006609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.006890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.007505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] PATH_INFO: `/v3/users/0bfd7c9ba3d34bc1b2268ba4ac30cc84` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.008962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfd7c9ba3d34bc1b2268ba4ac30cc84)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.011379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.031274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1066/2133] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:14 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:15.049998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:15.096515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa067653-a2cf-4c51-bcdb-82f8e82e0607 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.103945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfd7c9ba3d34bc1b2268ba4ac30cc84'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:15.105011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfd7c9ba3d34bc1b2268ba4ac30cc84'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:15.106000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfd7c9ba3d34bc1b2268ba4ac30cc84'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:15.116981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfd7c9ba3d34bc1b2268ba4ac30cc84'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:15.119782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.120793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.121806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.122112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.124319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.127024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.128674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-b6e8f8ed-bebf-4dd0-808e-6709b9b216ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfd7c9ba3d34bc1b2268ba4ac30cc84'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:15.148304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1067/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:15.152843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:15.154715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:15.170779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1068/2135] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:14 2022] DELETE /identity/v3/users/0bfd7c9ba3d34bc1b2268ba4ac30cc84 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:15.173338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957a0d-8e7a-47c1-80f8-6a40f533f50a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.178244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.178592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.180020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.200813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:15.202149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:15.252419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:15.257777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.258841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.259436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.259980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.261405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.263742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.285240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1068/2136] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:15.290095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:15.309366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12bb5e-dbc4-45c3-962a-9c3aa5b14173 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.313292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1069/2137] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:15.318701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.320263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.320853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.321648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] PATH_INFO: `/v3/projects/9ccd7db4353348a6b60cc7006968c93d/users/abc8760b6e4a4b1e88f8e20f43073292/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.334840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:15.338302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:15.352180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccd7db4353348a6b60cc7006968c93d, user_id=abc8760b6e4a4b1e88f8e20f43073292, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.360682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018c16d-05df-4b4a-82d9-a1c032c71dc3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.411101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1069/2138] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:15 2022] PUT /identity/v3/projects/9ccd7db4353348a6b60cc7006968c93d/users/abc8760b6e4a4b1e88f8e20f43073292/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:15.419142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.419519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.419995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.458108 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:15.459497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:15.464545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630a3d1-6c0c-4d5a-834c-a784660f4a26 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.562753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.562753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.563252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.563398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.592682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1070/2139] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:15.633072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:15.648826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20467da6-c003-4e85-a88d-2324b1a927ad None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:15.655648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:15.656729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:15.657823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:15.658203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:15.671891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.673570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.686842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1071/2140] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:15.716876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:15.720614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35763514-21f5-40d2-b4b6-9bd5bd669a56 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:15.751893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1070/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:16.700529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:16.703138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:16.723821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:16.746940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4d81c-1d8e-4378-8b2d-bb14438a5b2d service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:16.755014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:16.756950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:16.758671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:16.759410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] PATH_INFO: `/v3/projects/7f7b1e6f582344928572dc058d2fc509` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:16.762395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7b1e6f582344928572dc058d2fc509)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:16.766338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:16.860476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7b1e6f582344928572dc058d2fc509', 'request_id': 'req-9571354b-2651-45f1-a084-8ccd3bbe85cf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:16.871682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7b1e6f582344928572dc058d2fc509', 'request_id': 'req-9571354b-2651-45f1-a084-8ccd3bbe85cf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:16.886204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7b1e6f582344928572dc058d2fc509', 'request_id': 'req-9571354b-2651-45f1-a084-8ccd3bbe85cf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:16.933810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] The token cache is being invalidate because project 7f7b1e6f582344928572dc058d2fc509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:16.934163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:16.935011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9571354b-2651-45f1-a084-8ccd3bbe85cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:16.937187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1072/2142] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:16 2022] DELETE /identity/v3/projects/7f7b1e6f582344928572dc058d2fc509 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:16.945869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:16.946518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:16.946874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:16.989500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:16.992207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:17.069457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:17.111837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1071/2143] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:17.118128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.118857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.119711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.158482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:17.161411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:17.191521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1073/2144] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:17.201068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.224052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3f1c1-96e6-4582-ba2e-ee4423eb2d2b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.238901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.244582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.245598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.245935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.262497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:17.262497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.262497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.280712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1072/2145] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:17.287459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.302411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6285b3-9c96-4c8a-aaf8-ae502b74bc51 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.310781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.311617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.312065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.312454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.313583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.317453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.363825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1074/2146] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:17 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:17.370086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.394519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b60dc-1cdd-4fae-af5e-efad53889be0 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.532525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.533402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.533857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.534437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.535292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.538287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.574016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1073/2147] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:17 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:17.574488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.586175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a59264-a01c-4fef-9e62-61c07d416804 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.591919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.592820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.593210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.593593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.594530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.596449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.611807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1075/2148] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:48:17.615933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.631816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20152ccb-ea42-4713-9ae5-4bbb752e3dbe admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.646412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.647126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.647399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.647677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.648528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.650515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05150da-7874-4170-93d3-4474fa4bcdfb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.688998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1074/2149] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:48:17.692238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:17.708875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c30e47-67ff-407b-9422-9c9ff3e947b6 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:17.730281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:17.731428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.732104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.732536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] PATH_INFO: `/v3/projects/9260759b03a54889969f7c956d1f02e7/users/c4053a54ef30431f815d9b2a89d6582d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.752887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9260759b03a54889969f7c956d1f02e7, user_id=c4053a54ef30431f815d9b2a89d6582d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:17.765470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:17.797137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1076/2150] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:17 2022] PUT /identity/v3/projects/9260759b03a54889969f7c956d1f02e7/users/c4053a54ef30431f815d9b2a89d6582d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:17.811105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:17.811692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:17.812180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:17.878481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] MFA Rules not processed for user `c4053a54ef30431f815d9b2a89d6582d`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:17.879793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:18.031123 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1075/2151] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:18.037245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:18.184633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f424a-a419-4364-a932-b9134a574689 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:18.189595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:18.190676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.191657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.191657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.192324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:18.196050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:18.238925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1077/2152] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:18 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:18.245071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:18.265428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c61b67-7112-4ee8-97b7-53a919b60ffe None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:18.372360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:18.433054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:18.434737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.435616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.437079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.440521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:18.446751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:18.513611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:18.523462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1076/2153] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:18 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:18.542623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e6098-293d-4ac3-a3e1-493f89439c91 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:18.555904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:18.557608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.558234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.558835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.560438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:18.564635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:18.568207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:18.606375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:18.617689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1078/2154] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:18.633159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3854e78-8c74-4a2d-a117-329c549649fd admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:18.650951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:18.654629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.655205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.655738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.658647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:18.661806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d4051-33f0-4dc9-ad44-6766bd567e87 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:18.698059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1077/2155] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:18.703721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:18.719679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08436e9c-1898-447e-97ed-43b8bba80366 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:18.732625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:18.733852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.734367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.734927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] PATH_INFO: `/v3/projects/9530f02f65ee4f11a5117edd7af40764/users/49bc8f8646f6403f8f54e6f32ef5634d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.785084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530f02f65ee4f11a5117edd7af40764, user_id=49bc8f8646f6403f8f54e6f32ef5634d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:18.791579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:18.819082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1079/2156] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:18 2022] PUT /identity/v3/projects/9530f02f65ee4f11a5117edd7af40764/users/49bc8f8646f6403f8f54e6f32ef5634d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:18.832307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:18.832597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:18.832879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:18.866894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] MFA Rules not processed for user `49bc8f8646f6403f8f54e6f32ef5634d`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:18.868868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:18.972660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1078/2157] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:18.980174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.130654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb84f24-bd32-438c-8308-b33544018747 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.136826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.137583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.137867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.138201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.138910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.142177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.230274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1080/2158] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:18 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:19.236404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.259053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfe241-987f-4406-93a5-1a390831a907 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.418236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.419231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.419853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.420244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.421296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.425489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.461346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1079/2159] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:19 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:19.465540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.478709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff034153-cdc7-4549-911a-2e0bb207b9ed admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.484337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.485040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.485321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.485602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.487703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.488143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.505312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1081/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:19.507992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.530061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f900d5-04f1-40ac-bc36-d94dd2edb390 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.539985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.540957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.542367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.542664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] PATH_INFO: `/v3/projects/6e904ef2c6414086944ea4849cdcf3b3/users/e48decd3c6e44885b10f8305d9445f9a/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.570071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e904ef2c6414086944ea4849cdcf3b3, user_id=e48decd3c6e44885b10f8305d9445f9a, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.577163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.618824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1080/2161] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:19 2022] PUT /identity/v3/projects/6e904ef2c6414086944ea4849cdcf3b3/users/e48decd3c6e44885b10f8305d9445f9a/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:19.620869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.635288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b63ace-312e-4fa7-bcd0-6f66def6d767 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.794821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.796539 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.797092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.797550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.811018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.817872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993747cf-f6ae-49c2-84de-8729ea84f84a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.856794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1082/2162] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:19.858530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:19.926089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7f421-d3bb-434b-a3c1-ae8576875d8d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:19.941421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:19.946665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:19.947236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:19.949471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] PATH_INFO: `/v3/projects/6e904ef2c6414086944ea4849cdcf3b3/users/e48decd3c6e44885b10f8305d9445f9a/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:19.955628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e904ef2c6414086944ea4849cdcf3b3, user_id=e48decd3c6e44885b10f8305d9445f9a, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:19.962456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:19.980346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:19.995842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1081/2163] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:19 2022] PUT /identity/v3/projects/6e904ef2c6414086944ea4849cdcf3b3/users/e48decd3c6e44885b10f8305d9445f9a/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:20.021316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828d99-976c-40be-827a-9d90d978c83a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:20.022150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828d99-976c-40be-827a-9d90d978c83a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:20.023674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56828d99-976c-40be-827a-9d90d978c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:20.135323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-56828d99-976c-40be-827a-9d90d978c83a None None] MFA Rules not processed for user `e48decd3c6e44885b10f8305d9445f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:20.142294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-56828d99-976c-40be-827a-9d90d978c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:20.251855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:20.377682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1083/2164] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:20.393096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:20.395497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:20.539304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330388a-7c4a-479e-8d66-d7e615668ec1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:20.544639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:20.545339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:20.545624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:20.545901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:20.638377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:20.641164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe823f2f-6404-4b04-af9d-c161cada8a42 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:20.659411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1082/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:21.419187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56828d99-976c-40be-827a-9d90d978c83a None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:21.424371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-56828d99-976c-40be-827a-9d90d978c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:21.563603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56828d99-976c-40be-827a-9d90d978c83a None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:21.571503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:21.573577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:21.574073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:21.574492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] PATH_INFO: `/v3/users/813ee9cdd04f43c4a0bf7602cd94024e` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:21.576146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813ee9cdd04f43c4a0bf7602cd94024e)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:21.581796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:21.677975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813ee9cdd04f43c4a0bf7602cd94024e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:21.690297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813ee9cdd04f43c4a0bf7602cd94024e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:21.691278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813ee9cdd04f43c4a0bf7602cd94024e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:21.706904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813ee9cdd04f43c4a0bf7602cd94024e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:21.786416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813ee9cdd04f43c4a0bf7602cd94024e'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:21.797102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1084/2166] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:21 2022] DELETE /identity/v3/users/813ee9cdd04f43c4a0bf7602cd94024e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:21.803470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:21.804783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:21.805722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:21.864886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:21.866321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:22.087305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1083/2167] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:22.114020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:22.116845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:22.317095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:22.345010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe95c-015d-46b2-b2f9-61c5e065ebc3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:22.363287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:22.364450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:22.364926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:22.365399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:22.406142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:22.409584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:22.455474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1085/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:22.705527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:22.708215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:22.916591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06698e70-4e6d-4125-a0f9-549a227f8c9f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:22.925203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:22.926563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:22.927146 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:22.927891 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:22.932720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:22.954070 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:23.165479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:23.170724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023221-327e-4442-913f-85ccd4156dca service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:23.192317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1084/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:23.498912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:23.528614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:23.608000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84faa5-5fd6-47ff-afeb-cb1682cdb599 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:23.628378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:23.632772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:23.634455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:23.635193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] PATH_INFO: `/v3/projects/d6fdb41c241e4c85ad94d4f47f8f22be` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:23.643586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fdb41c241e4c85ad94d4f47f8f22be)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:23.652533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:23.823061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fdb41c241e4c85ad94d4f47f8f22be', 'request_id': 'req-05090e2d-d9f1-4239-b65f-be3e2b5cf047'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:23.854710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fdb41c241e4c85ad94d4f47f8f22be', 'request_id': 'req-05090e2d-d9f1-4239-b65f-be3e2b5cf047'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:23.868533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fdb41c241e4c85ad94d4f47f8f22be', 'request_id': 'req-05090e2d-d9f1-4239-b65f-be3e2b5cf047'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:23.913540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] The token cache is being invalidate because project d6fdb41c241e4c85ad94d4f47f8f22be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:23.914206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:23.917636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-05090e2d-d9f1-4239-b65f-be3e2b5cf047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:23.923855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1086/2170] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:23 2022] DELETE /identity/v3/projects/d6fdb41c241e4c85ad94d4f47f8f22be => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:23.932952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:23.933512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:23.933512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:23.980738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:23.982087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:24.149139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1085/2171] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:24.159445 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:24.160063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:24.160717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:24.237027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:24.241695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:24.277403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1087/2172] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:24.283591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:24.299989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b022a4c-0807-40d9-b6ec-9ec855e5e9ce None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:24.328989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:24.330201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:24.330686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:24.331191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:24.333587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:24.336646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:24.339882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:24.400616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1086/2173] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:24.407418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:24.425277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912605e-6af2-485b-965d-2a0db6d673f3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:24.446455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:24.447338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:24.447626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:24.447911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:24.448478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:24.449517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:24.451730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:24.455227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:24.535551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1088/2174] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:24 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:24.539915 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:24.636930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488eec65-4729-4340-a557-09d8ebd12b1f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:24.847970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a916c3-c57f-41fd-8c5f-598f4a4c5b7e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:24.849965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:24.852947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:24.854010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:24.854509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:24.869477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:24.870917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:24.873465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:24.879558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:24.880334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:24.882443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:24.887735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:24.924029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:24.997723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1089/2175] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:24 2022] POST /identity/v3/users => generated 287 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:24.999585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.040192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023cd5-974f-42ed-b6ce-d74e8c34e725 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:25.059119 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:25.059854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.060296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.065261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.067361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:25.071416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:25.093255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1090/2176] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:25.100382 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.127943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a17c77-8b7c-4dd9-ac0f-842e16f52863 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:25.141813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:25.142856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.143283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.143826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.144901 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:25.152428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:25.177272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1091/2177] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:25.184038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.187429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:25.191324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5f54-0aca-4cce-913f-94ae9d923b41 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:25.229848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b980-706e-479d-afb1-578dcc3266b2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:25.230231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1087/2178] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:25.279283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:25.281073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.282169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.282619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] PATH_INFO: `/v3/projects/06b08f101ee84ff3825bd1a20f9d45b9/users/e1c563d7723346a9bbee070d694f952f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.324344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:25.353251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b08f101ee84ff3825bd1a20f9d45b9, user_id=e1c563d7723346a9bbee070d694f952f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:25.380169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:25.470384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1092/2179] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:25 2022] PUT /identity/v3/projects/06b08f101ee84ff3825bd1a20f9d45b9/users/e1c563d7723346a9bbee070d694f952f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:25.483901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729663-35ed-417a-8740-4516115da4fc None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.484287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729663-35ed-417a-8740-4516115da4fc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.484644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729663-35ed-417a-8740-4516115da4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.527768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ff729663-35ed-417a-8740-4516115da4fc None None] MFA Rules not processed for user `e1c563d7723346a9bbee070d694f952f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:25.530774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ff729663-35ed-417a-8740-4516115da4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:25.650193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1088/2180] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:25.670344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.753629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.754218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.763999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.785379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d5d92-bc3f-4099-aed1-f5fc103bb92b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:25.790506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:25.791663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:25.791663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:25.792103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:25.823683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:25.823683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:25.839410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] MFA Rules not processed for user `abc8760b6e4a4b1e88f8e20f43073292`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:25.840745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:25.862124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1093/2181] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:25.914776 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.986248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1089/2182] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:25.990405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:25.992048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:26.013714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c468f-b3b1-4a56-9f25-819df68cc5af service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.019908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.020928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.021451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.021878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] PATH_INFO: `/v3/users/e1c563d7723346a9bbee070d694f952f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.023514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c563d7723346a9bbee070d694f952f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.025548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.027915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:26.084970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af03a0-e82d-477f-8690-58387fbf9859 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.089107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c563d7723346a9bbee070d694f952f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:26.091931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.092789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.093162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.093488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.094381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.096629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.099457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c563d7723346a9bbee070d694f952f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:26.101880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c563d7723346a9bbee070d694f952f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:26.113493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c563d7723346a9bbee070d694f952f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:26.133515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d4d90c7-5044-4de5-b19e-7a24af5eabaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c563d7723346a9bbee070d694f952f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:26.145337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1094/2183] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:25 2022] DELETE /identity/v3/users/e1c563d7723346a9bbee070d694f952f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:26.148893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1090/2184] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:25 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:26.153383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.153876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.154224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.154502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.158307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:26.181571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:26.181571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:26.188181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:26.255353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547e4be-4dc3-41c5-9d59-97062f795e65 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.262087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.263157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.263601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.264169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.265605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.268636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1095/2185] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:26.270335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.283698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.285827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:26.309051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1091/2186] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:26 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:26.310542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.347180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9671c39-8880-4836-9cfb-09fa41b4e3c7 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.357990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.359429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.359900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.360215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.361239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.363426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.379785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1092/2187] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:48:26.385866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.398684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695a1cf-b37d-4bbc-9de8-cdf09e0fd03f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.404587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.405621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.406458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.406840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] PATH_INFO: `/v3/projects/1c684aa085324aed9e7deb7271ec64a9/users/ae3124b095444da9bab8796c751557c6/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.430995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c684aa085324aed9e7deb7271ec64a9, user_id=ae3124b095444da9bab8796c751557c6, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.434301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.438289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01571099-886a-4f80-846f-6fe75d010e08 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.448083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.448991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.449629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.449869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.471143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1093/2188] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:26 2022] PUT /identity/v3/projects/1c684aa085324aed9e7deb7271ec64a9/users/ae3124b095444da9bab8796c751557c6/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:26.475548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.477248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.480997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.507565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1096/2189] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:26.628512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dbd47-ce03-49e3-937c-05c67d3039a8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.644646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.646063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.646063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.646063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.646724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.648966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.659735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:26.674765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1094/2190] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:26.681175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:26.701165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d785be-8012-46ae-8339-7b1f24c9c32c service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:26.723200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:26.724381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:26.724826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:26.725266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] PATH_INFO: `/v3/projects/1c684aa085324aed9e7deb7271ec64a9/users/ae3124b095444da9bab8796c751557c6/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:26.729798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c684aa085324aed9e7deb7271ec64a9, user_id=ae3124b095444da9bab8796c751557c6, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:26.734912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0106d6-7720-4f02-9303-d2cfcae45d72 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:26.754111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1097/2191] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:26 2022] PUT /identity/v3/projects/1c684aa085324aed9e7deb7271ec64a9/users/ae3124b095444da9bab8796c751557c6/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:27.317707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:27.325235 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:27.349007 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfea51-1629-42ad-a6a1-6e33ec74848a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:27.474288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:27.475220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:27.475685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:27.476232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] PATH_INFO: `/v3/projects/06b08f101ee84ff3825bd1a20f9d45b9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:27.478588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b08f101ee84ff3825bd1a20f9d45b9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:27.480642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:27.566387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b08f101ee84ff3825bd1a20f9d45b9', 'request_id': 'req-e4668858-7faa-4f0c-9e5f-8780a33dafe4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:27.573716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b08f101ee84ff3825bd1a20f9d45b9', 'request_id': 'req-e4668858-7faa-4f0c-9e5f-8780a33dafe4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:27.581511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b08f101ee84ff3825bd1a20f9d45b9', 'request_id': 'req-e4668858-7faa-4f0c-9e5f-8780a33dafe4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:27.597106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] The token cache is being invalidate because project 06b08f101ee84ff3825bd1a20f9d45b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:27.597404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:27.598114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e4668858-7faa-4f0c-9e5f-8780a33dafe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:27.603933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1095/2192] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:27 2022] DELETE /identity/v3/projects/06b08f101ee84ff3825bd1a20f9d45b9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:27.605823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:27.606149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:27.606446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:27.628536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:27.629869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:27.739308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1098/2193] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:27.742386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:27.743008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:27.743606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:27.769777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:27.771069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:27.781989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1096/2194] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:27.787724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:27.800034 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70bb60-8305-4258-a61c-85c8d8ee6443 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:27.810657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:27.811420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:27.811749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:27.812477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:27.814482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:27.814983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:27.817589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:27.838504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1099/2195] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:27.843191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:27.858734 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3764-0893-45e9-9d86-9b2e1ae6d7b0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:27.899283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:27.900045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:27.900324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:27.902770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:27.904775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:27.910647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:28.001370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1097/2196] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:27 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:28.007349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:28.023925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b108f-215b-4c36-b66c-3905803113bd admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:28.132558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:28.261414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:28.264773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:28.268923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:28.271329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:28.272224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:28.286790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:28.372691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1100/2197] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:28 2022] POST /identity/v3/users => generated 285 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:28.374718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:28.398606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9281e4-a8ff-497d-a1f4-1076084b8d32 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:28.426320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:28.429149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:28.431785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:28.433211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:28.443334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:28.445390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:28.514646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1098/2198] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:28.520805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:28.543037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9802-bcc0-4ff0-9280-8a0d68c1e1ca admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:28.562386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:28.566154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:28.568668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:28.569017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:28.570026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:28.576271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac58ea-e229-4c3e-a782-007f9e894b16 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:28.615693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:28.628099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1101/2199] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:48:28.630003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a9149-363f-404d-81cf-2982b0d06af3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:28.649760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:28.650870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:28.651196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:28.652204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] PATH_INFO: `/v3/projects/01fe3c7e1d2e4dd1bb110de1133b7916/users/542485de58954e27999e2ad9d397dee8/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:28.680171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01fe3c7e1d2e4dd1bb110de1133b7916, user_id=542485de58954e27999e2ad9d397dee8, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:28.684972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:28.719164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1099/2200] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:28 2022] PUT /identity/v3/projects/01fe3c7e1d2e4dd1bb110de1133b7916/users/542485de58954e27999e2ad9d397dee8/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:28.724827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:28.725518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:28.726029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:28.760000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:28.773643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:28.894974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1102/2201] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:28.902310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:28.904460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:28.945458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:29.006234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cb3e1-c722-4704-877b-a953dd4ab683 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:29.011377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:29.012416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:29.012990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:29.013707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:29.028932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:29.030795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bd445-6c0a-4fe5-817c-23eeccbffd77 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:29.046259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1100/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:30.195763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:30.199765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:30.286933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd061d-fc1c-404d-b042-6e02330dffed None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:30.319464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:30.326815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:30.327431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:30.330452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] PATH_INFO: `/v3/users/c4053a54ef30431f815d9b2a89d6582d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:30.340866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4053a54ef30431f815d9b2a89d6582d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:30.364927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:30.543759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4053a54ef30431f815d9b2a89d6582d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:30.567176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4053a54ef30431f815d9b2a89d6582d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:30.569602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4053a54ef30431f815d9b2a89d6582d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:30.592837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4053a54ef30431f815d9b2a89d6582d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:30.622745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4053a54ef30431f815d9b2a89d6582d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:30.638624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1103/2203] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:30 2022] DELETE /identity/v3/users/c4053a54ef30431f815d9b2a89d6582d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:30.644459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b53-2073-4699-8151-d619f47733fc None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:30.644459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b53-2073-4699-8151-d619f47733fc None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:30.645600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4065b53-2073-4699-8151-d619f47733fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:30.684309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e4065b53-2073-4699-8151-d619f47733fc None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:30.688522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e4065b53-2073-4699-8151-d619f47733fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:30.890052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1101/2204] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:30.918882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:30.922387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:30.980730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:31.054998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d158656-c634-4ed5-bfb4-5b3c1d8f2e17 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:31.075043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:31.075043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:31.075043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:31.075043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:31.091509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:31.094405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:31.119689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1104/2205] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:31.821483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065b53-2073-4699-8151-d619f47733fc None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:31.823882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e4065b53-2073-4699-8151-d619f47733fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:32.074592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4065b53-2073-4699-8151-d619f47733fc None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:32.090819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:32.091928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:32.094265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:32.094660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:32.105916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:32.325750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:32.330114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:32.391544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1102/2206] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:48:33.880870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:33.886010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:33.958836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf962-57cd-4df1-a7c2-6624e6610660 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:34.012094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:34.021189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:34.026550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:34.027380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] PATH_INFO: `/v3/projects/9260759b03a54889969f7c956d1f02e7` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:34.035092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9260759b03a54889969f7c956d1f02e7)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:34.043423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:34.187457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9260759b03a54889969f7c956d1f02e7', 'request_id': 'req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:34.203021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9260759b03a54889969f7c956d1f02e7', 'request_id': 'req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:34.214010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9260759b03a54889969f7c956d1f02e7', 'request_id': 'req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:34.264617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] The token cache is being invalidate because project 9260759b03a54889969f7c956d1f02e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:34.267568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:34.268995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:34.283091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1105/2207] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:33 2022] DELETE /identity/v3/projects/9260759b03a54889969f7c956d1f02e7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:34.290200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:34.325556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc67a38-bce6-4e1c-8091-d34a64fcac12 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:34.475625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:34.750850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:34.752387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:34.753036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:34.754522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] PATH_INFO: `/v3/users/49bc8f8646f6403f8f54e6f32ef5634d` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:34.774422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bc8f8646f6403f8f54e6f32ef5634d)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:34.788622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:35.053034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bc8f8646f6403f8f54e6f32ef5634d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:35.054278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bc8f8646f6403f8f54e6f32ef5634d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:35.056672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bc8f8646f6403f8f54e6f32ef5634d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:35.092779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bc8f8646f6403f8f54e6f32ef5634d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:35.129126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bc8f8646f6403f8f54e6f32ef5634d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:35.204797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1103/2208] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:34 2022] DELETE /identity/v3/users/49bc8f8646f6403f8f54e6f32ef5634d => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:37.309340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:37.313722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:37.364978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3b0b7-4aca-4e2b-aac7-9bdc89cc01c3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:37.521621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:37.523130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:37.525825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:37.526164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] PATH_INFO: `/v3/projects/9530f02f65ee4f11a5117edd7af40764` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:37.528428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530f02f65ee4f11a5117edd7af40764)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:37.535497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:37.669664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:37.684418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530f02f65ee4f11a5117edd7af40764', 'request_id': 'req-80d5126d-a164-4095-a77a-db6d3640fe0d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:37.703491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530f02f65ee4f11a5117edd7af40764', 'request_id': 'req-80d5126d-a164-4095-a77a-db6d3640fe0d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:37.722356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530f02f65ee4f11a5117edd7af40764', 'request_id': 'req-80d5126d-a164-4095-a77a-db6d3640fe0d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:37.753921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] The token cache is being invalidate because project 9530f02f65ee4f11a5117edd7af40764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:37.756205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:37.757446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:37.759947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1106/2209] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:37 2022] DELETE /identity/v3/projects/9530f02f65ee4f11a5117edd7af40764 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:37.764440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:37.766036 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:37.809335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536389-9e05-4cd8-b7b1-4448ef901377 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:38.044317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:38.046519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:38.046991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:38.047411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] PATH_INFO: `/v3/users/e48decd3c6e44885b10f8305d9445f9a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:38.049733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48decd3c6e44885b10f8305d9445f9a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:38.055121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:38.279696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:38.308063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48decd3c6e44885b10f8305d9445f9a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:38.337872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48decd3c6e44885b10f8305d9445f9a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:38.338798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48decd3c6e44885b10f8305d9445f9a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:38.424769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48decd3c6e44885b10f8305d9445f9a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:38.457282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-86a4d8db-1415-4540-9436-35ba63c80160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48decd3c6e44885b10f8305d9445f9a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:38.541427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1104/2210] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:37 2022] DELETE /identity/v3/users/e48decd3c6e44885b10f8305d9445f9a => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:40.202293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:40.204109 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:40.275591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5126d-a164-4095-a77a-db6d3640fe0d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:40.590804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:40.591968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:40.594526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:40.594994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] PATH_INFO: `/v3/projects/6e904ef2c6414086944ea4849cdcf3b3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:40.598834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e904ef2c6414086944ea4849cdcf3b3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:40.605495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:40.736206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e904ef2c6414086944ea4849cdcf3b3', 'request_id': 'req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:40.755372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e904ef2c6414086944ea4849cdcf3b3', 'request_id': 'req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:40.808855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e904ef2c6414086944ea4849cdcf3b3', 'request_id': 'req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:40.844526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] The token cache is being invalidate because project 6e904ef2c6414086944ea4849cdcf3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:48:40.845110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:40.846337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b1311ad5-c8d3-4754-a76e-b7e286afa6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:40.853313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1107/2211] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:48:40 2022] DELETE /identity/v3/projects/6e904ef2c6414086944ea4849cdcf3b3 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:40.856816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:40.857396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:40.857396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:40.938033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:40.940665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:41.112005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1105/2212] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:41.120713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.121028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.121309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.165141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:41.166640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:41.186866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1108/2213] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:41.193638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.229143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bbbe9-f3bd-49f7-99bc-8dbea35abc1c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.243879 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.244678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.247175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.247986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.248865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:48:41.251544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.253346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:41.285900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1106/2214] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:48:41.289592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.299879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69f7c2-7d0b-4324-95db-7757a0227667 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.314868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.315626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.315938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.316219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.316977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.319065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2434a-2bbc-4942-9fb2-d0c217c8108e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:41.381526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1109/2215] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:41 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:41.383711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.415536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3da9d-dabd-4f51-a909-dde503033975 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.486091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.486383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.486670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.562939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] MFA Rules not processed for user `ae3124b095444da9bab8796c751557c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:41.566786 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:41.640051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.642811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.643060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.643584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:41.644568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.645273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.649197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:41.715172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1107/2216] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:41 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:48:41.718452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.749744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87450c60-e466-401f-be2d-f332a67679da admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.779172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.779297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.779586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.780236 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.780603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.783513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:41.790158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1110/2217] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:41.795066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.800463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:41.813463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1108/2218] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:41.815208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.838652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c9cb-d529-4795-b741-2b3a6aa30f66 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.852156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.853443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.858426 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.859383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.862915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.864775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:41.907197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1109/2219] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:41.911430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:41.929185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2038-a989-4398-a4e0-f02f9e0346c7 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:41.945597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:41.946752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:41.947037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:41.947320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] PATH_INFO: `/v3/projects/e26786d227be4c2c943740b406bfaa03/users/5b0b16370fdf477fa845bf6a1d25d83b/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:41.961221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:41.994437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26786d227be4c2c943740b406bfaa03, user_id=5b0b16370fdf477fa845bf6a1d25d83b, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:41.995005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a09463-bae5-4ca8-93a6-4c1881e6d361 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:42.006564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:42.008051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.009591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.010210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.011258 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6195f-6790-492c-a8c7-aa6dc9622893 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:42.017808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.053729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1110/2220] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:41 2022] PUT /identity/v3/projects/e26786d227be4c2c943740b406bfaa03/users/5b0b16370fdf477fa845bf6a1d25d83b/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:48:42.066239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.067375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.071675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.145527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:42.146872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.170455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:42.172911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41f92e-dd61-413b-95eb-ff666df88adc service glance] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:42.186751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1111/2221] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:42.188834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.190174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.190666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.241638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] MFA Rules not processed for user `542485de58954e27999e2ad9d397dee8`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:42.244017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.309305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1111/2222] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:42.325775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:42.327956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.420484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1112/2223] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:42.421562 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:42.424505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.454777 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:42.465846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0f29b-2b0c-4d26-b637-3e190cce28da None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:42.479673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe9d4-f3de-4c65-a62e-75186f940d6e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:42.480557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:42.481459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.481784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.482187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.483013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:42.484526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:42.485195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.485480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.485760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.490945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:42.497005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:42.498541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b34cc-14c5-480b-8430-60a15ce0afdc service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:42.510420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1112/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:42.511798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.512087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.512365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.556242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1113/2225] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:48:42 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:42.557750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:42.559414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.560713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:42.698695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1113/2226] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:48:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:42.822291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:42.825570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:42.837218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011734f6-381c-4bf8-8c9d-e3ead1e25e52 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:42.865627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:42.869096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:42.880682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:42.880962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:42.884381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:42.896075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:42.950130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:42.970087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1114/2227] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:48:42 2022] POST /identity/v3/users => generated 292 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:48:42.974359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:43.005804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700cd61-89b0-4589-ba77-54d96a747d8f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:43.021149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:43.023257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:43.024924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:43.025652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:43.029028 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:43.033437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:43.048441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374cd0-a335-43c0-8b64-aac948f8a5a6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:43.074788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1115/2228] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:43.081387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:43.082324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:43.083965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:43.084843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:43.085459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:43.112465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:43.114548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:43.116674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aea834-4f22-42dd-b622-31851fb285c8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:43.134331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:43.136979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:43.138487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:43.139332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] PATH_INFO: `/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c/users/8d1ecde854df4c258217a7ecffdf7306/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:43.140921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1114/2229] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:48:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:48:43.269545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7d85a558a74f1a813ef6dc67e06b5c, user_id=8d1ecde854df4c258217a7ecffdf7306, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:43.279125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:43.361995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1116/2230] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:43 2022] PUT /identity/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c/users/8d1ecde854df4c258217a7ecffdf7306/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:43.365894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:43.384055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1aedd-6c54-4e94-a974-d65d44c501c3 service swift] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:43.835530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:43.836249 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:43.836542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:43.836827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:43.837595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:43.851324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0021d-aaad-420f-b174-c40c859852fe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:43.919635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1115/2231] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:48:43.924375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:43.963919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2579ad0-7ae1-455c-9f57-e1897bba8105 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:43.969332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:43.970745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:43.971178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:43.971618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] PATH_INFO: `/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c/users/8d1ecde854df4c258217a7ecffdf7306/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:43.975732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7d85a558a74f1a813ef6dc67e06b5c, user_id=8d1ecde854df4c258217a7ecffdf7306, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:43.980648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:44.002890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1117/2232] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:48:43 2022] PUT /identity/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c/users/8d1ecde854df4c258217a7ecffdf7306/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:44.722594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900894d-b987-4462-8e4b-7ff33fafc65d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:44.723149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900894d-b987-4462-8e4b-7ff33fafc65d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:44.730210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900894d-b987-4462-8e4b-7ff33fafc65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:44.855776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c900894d-b987-4462-8e4b-7ff33fafc65d None None] MFA Rules not processed for user `5b0b16370fdf477fa845bf6a1d25d83b`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:44.858958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c900894d-b987-4462-8e4b-7ff33fafc65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:45.203098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1116/2233] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:45.221031 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:45.227532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:45.532208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f8d1f-99bb-4456-9df9-840ca1b8efda admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:45.541035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:45.541741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:45.542133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:45.542412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:45.563363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:45.565124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f8e41-08a5-469e-8f66-d15183a3d9ee service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:45.588480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1118/2234] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:48:48.423547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:48.425044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:48.425659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:48.475169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] MFA Rules not processed for user `5b0b16370fdf477fa845bf6a1d25d83b`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:48.482174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:48.536705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1117/2235] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:48:55.575024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=82,keystone:INSERT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:56.489624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:56.491716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:56.492487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:56.517514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:56.520442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:56.600914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:56.605139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:56.870039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:57.058448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1119/2236] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:48:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:57.092694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:57.114775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d521f0d-ade6-4548-b705-d99aea11edc8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:57.141839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:57.143552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:57.147169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:57.148169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] PATH_INFO: `/v3/users/5250626930844a86b9249eef6c1c9372` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:57.159399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5250626930844a86b9249eef6c1c9372)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:57.161990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:57.396377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5250626930844a86b9249eef6c1c9372'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:57.399730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5250626930844a86b9249eef6c1c9372'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:57.402164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5250626930844a86b9249eef6c1c9372'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:57.432988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a7d1e-c862-448d-bc1b-14471215ae68 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:57.445416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5250626930844a86b9249eef6c1c9372'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:57.467479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:57.471374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:57.472812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:57.474323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:57.487906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5250626930844a86b9249eef6c1c9372'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:48:57.489159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:57.529921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:57.532897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f16d4b-6d07-4486-aa09-27f305db8365 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:57.559449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1120/2237] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:48:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:48:57.648590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1118/2238] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:48:56 2022] DELETE /identity/v3/users/5250626930844a86b9249eef6c1c9372 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:48:57.654003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e856f-69a3-447c-9d98-32d8486d8a2e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:57.654583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e856f-69a3-447c-9d98-32d8486d8a2e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:57.654745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e856f-69a3-447c-9d98-32d8486d8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:57.795292 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-bf8e856f-69a3-447c-9d98-32d8486d8a2e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:48:57.811147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bf8e856f-69a3-447c-9d98-32d8486d8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:58.170200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:58.195671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1121/2239] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:48:58.261815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:48:58.264591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:48:58.740736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:48:58.817995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a794f7-c76c-417a-9559-61aa4f1be073 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:48:58.834076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:48:58.836402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:48:58.837631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:48:58.839139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:48:58.882167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:48:58.883797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:48:58.937794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1119/2240] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:00.346110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:00.347181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:00.347181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:00.454171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] MFA Rules not processed for user `8d1ecde854df4c258217a7ecffdf7306`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:00.459020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:00.618784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:00.621421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:00.687737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352203-aa89-4ca2-a582-72eace0a57cd service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:00.707475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:00.711351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:00.712094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:00.712617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] PATH_INFO: `/v3/projects/4f04f809edd840e6b34c9ed1f62293d8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:00.717958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f04f809edd840e6b34c9ed1f62293d8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:00.725666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:00.727675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1122/2241] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:01.040541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f04f809edd840e6b34c9ed1f62293d8', 'request_id': 'req-5c338ebc-1213-40a0-a626-70bed95a0b3d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.078153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f04f809edd840e6b34c9ed1f62293d8', 'request_id': 'req-5c338ebc-1213-40a0-a626-70bed95a0b3d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.110520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f04f809edd840e6b34c9ed1f62293d8', 'request_id': 'req-5c338ebc-1213-40a0-a626-70bed95a0b3d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.116465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:01.118165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:01.160402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] The token cache is being invalidate because project 4f04f809edd840e6b34c9ed1f62293d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:01.160749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.163353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.172344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1120/2242] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:00 2022] DELETE /identity/v3/projects/4f04f809edd840e6b34c9ed1f62293d8 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:01.180482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:01.190492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:01.396240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c338ebc-1213-40a0-a626-70bed95a0b3d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:01.416247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:01.418529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:01.418529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:01.418918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] PATH_INFO: `/v3/users/7b03a91910a347b7993d370e8e5778e8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:01.426141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b03a91910a347b7993d370e8e5778e8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:01.433613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:01.480431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c85c4-f253-4dd2-9239-d15126b89814 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:01.631637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b03a91910a347b7993d370e8e5778e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.638457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b03a91910a347b7993d370e8e5778e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.644553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b03a91910a347b7993d370e8e5778e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.685227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b03a91910a347b7993d370e8e5778e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.716494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b03a91910a347b7993d370e8e5778e8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:01.738033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:01.792057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:01.793246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:01.793774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:01.795897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:01.799554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:01.830479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1121/2243] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:01 2022] DELETE /identity/v3/users/7b03a91910a347b7993d370e8e5778e8 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:01.836409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:01.900994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:01.906280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d1038-756b-4754-955d-603070a0c5a2 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:01.934766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1123/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 819 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:49:03.977134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:03.979855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:04.305281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd01bf-bf24-406f-a7da-0434519cf8fc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:04.339355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121455b-039c-4314-943c-15029436dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:04.340274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121455b-039c-4314-943c-15029436dacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:04.340560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121455b-039c-4314-943c-15029436dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:04.340840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121455b-039c-4314-943c-15029436dacf admin admin] PATH_INFO: `/v3/projects/af8d67a4519040e998d86c2f9f0df976` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:04.354292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121455b-039c-4314-943c-15029436dacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8d67a4519040e998d86c2f9f0df976)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:04.356034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121455b-039c-4314-943c-15029436dacf admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:04.597326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8d67a4519040e998d86c2f9f0df976', 'request_id': 'req-d121455b-039c-4314-943c-15029436dacf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:04.642009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8d67a4519040e998d86c2f9f0df976', 'request_id': 'req-d121455b-039c-4314-943c-15029436dacf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:04.653573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8d67a4519040e998d86c2f9f0df976', 'request_id': 'req-d121455b-039c-4314-943c-15029436dacf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:04.685430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] The token cache is being invalidate because project af8d67a4519040e998d86c2f9f0df976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:04.686056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:04.686936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d121455b-039c-4314-943c-15029436dacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:04.691175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1122/2245] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:03 2022] DELETE /identity/v3/projects/af8d67a4519040e998d86c2f9f0df976 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:04.696624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665b7-2745-4482-8839-61c15c155c2d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:04.698294 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665b7-2745-4482-8839-61c15c155c2d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:04.698778 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665b7-2745-4482-8839-61c15c155c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:04.806283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-482665b7-2745-4482-8839-61c15c155c2d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:04.813695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-482665b7-2745-4482-8839-61c15c155c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:05.192737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1124/2246] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:05.205861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:05.207211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:05.207720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:05.298064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:05.305834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:05.360067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482665b7-2745-4482-8839-61c15c155c2d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:05.364852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1123/2247] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:05.375399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482665b7-2745-4482-8839-61c15c155c2d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:05.398181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:05.401180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:05.401489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:05.401761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:05.402620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:49:05.402988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:05.426279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:05.460167 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1125/2248] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:49:05.466497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:05.481294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6e8a7-aa1b-41c6-829f-d1d39728410c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:05.502296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:05.502835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:05.503777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:05.504151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:05.508469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:05.518179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:05.625407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:05.627961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1124/2249] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:05 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:05.648004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98115220-0bcc-46ea-9478-86e4365f6f78 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:05.839780 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:05.840489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:05.841348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:05.841348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:05.842241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:05.853922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:05.931061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1126/2250] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:05 2022] POST /identity/v3/users => generated 289 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:05.932147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:05.955332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab76d7-5057-4e36-b685-823c29f97c30 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:05.960625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:05.961816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:05.962359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:05.966641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:05.967853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:05.973518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:06.036813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1125/2251] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:06.038709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:06.060835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44daef-b639-4097-9eed-e217ca08cfae admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:06.074658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:06.075756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:06.077059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:06.085772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:06.087274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:06.089362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3865-a20a-4351-9892-3652218611b8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:06.134514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:06.148007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1127/2252] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:06.159222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf5d8-f503-456a-900d-b5d20f3e2103 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:06.182206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:06.184252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:06.184545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:06.184814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] PATH_INFO: `/v3/projects/35222e343cd342d0b0c68e60da9c5765/users/2955886bb30d45efa747a761d75f9c11/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:06.225139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35222e343cd342d0b0c68e60da9c5765, user_id=2955886bb30d45efa747a761d75f9c11, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:06.231312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:06.292849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1126/2253] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:06 2022] PUT /identity/v3/projects/35222e343cd342d0b0c68e60da9c5765/users/2955886bb30d45efa747a761d75f9c11/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:06.305470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:06.306971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:06.306971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:06.353717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:06.376925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] MFA Rules not processed for user `2955886bb30d45efa747a761d75f9c11`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:06.379224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:06.611772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1128/2254] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:06.617768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:06.646521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:06.759214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a9e60-555d-484e-80ed-38d6317b523f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:06.777811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:06.778643 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:06.778998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:06.779340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:06.780487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:06.783380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:06.848096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1127/2255] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:06 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:06.849828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:06.937466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e8d6-6714-4f9d-aa62-993442c436cc None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:07.135551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:07.138150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:07.141260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:07.142329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:07.145206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:07.154286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:07.290179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1129/2256] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:06 2022] POST /identity/v3/users => generated 294 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:07.296592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:07.316197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e2813-5171-4811-93d2-087197ea126a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:07.334996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:07.336170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:07.338105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:07.340008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:07.341931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:07.346481 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:07.386248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1128/2257] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:07.386756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:07.400863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6e8d-bb75-49a6-8a33-bc0932900d4d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:07.418962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:07.421683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:07.422891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:07.423271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] PATH_INFO: `/v3/projects/7c410fa22ce345ea84b40406834a08c5/users/89502f2cc4f64be8bc633a13188a054e/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:07.509409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c410fa22ce345ea84b40406834a08c5, user_id=89502f2cc4f64be8bc633a13188a054e, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:07.517876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6470d2-2fd7-4a90-889f-9e22937fa3c6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:07.576839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1130/2258] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:07 2022] PUT /identity/v3/projects/7c410fa22ce345ea84b40406834a08c5/users/89502f2cc4f64be8bc633a13188a054e/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:49:07.578843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:07.612588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac4735-aeb3-454a-8607-054180343e27 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:07.770140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:07.770140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:07.770140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:07.823757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] MFA Rules not processed for user `542485de58954e27999e2ad9d397dee8`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:07.832416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:07.935282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:07.936934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:07.942686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:07.943408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:07.946339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:07.948677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:08.000468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1129/2259] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:08.002860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:08.033729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e846231-47bb-4289-80f1-5920557c235c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:08.045962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:08.047058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:08.047454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:08.047845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] PATH_INFO: `/v3/projects/7c410fa22ce345ea84b40406834a08c5/users/89502f2cc4f64be8bc633a13188a054e/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:08.051422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c410fa22ce345ea84b40406834a08c5, user_id=89502f2cc4f64be8bc633a13188a054e, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:08.056261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66249781-1fe6-4853-a780-88206f30c333 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:08.099071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1130/2260] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:08 2022] PUT /identity/v3/projects/7c410fa22ce345ea84b40406834a08c5/users/89502f2cc4f64be8bc633a13188a054e/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:08.101287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:08.105494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:08.106009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:08.183052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] MFA Rules not processed for user `89502f2cc4f64be8bc633a13188a054e`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:08.183339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1131/2261] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:08.184080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:08.406368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:08.423556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1131/2262] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:08.432896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:08.434623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:08.462545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:08.568418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96751cc1-b11b-42c8-a9f7-765df23990b6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:08.636774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:08.637611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:08.638051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:08.638435 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:08.726706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:08.728632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:08.741541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1132/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:12.094038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:12.100420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:12.312657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9f6e3-0400-4f9d-9daf-d230c1c5e93d None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:12.329257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:12.334608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:12.336498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:12.336837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] PATH_INFO: `/v3/users/39cf6fe7b4b6420da1aba08386b72168` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:12.340290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cf6fe7b4b6420da1aba08386b72168)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:12.352884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:12.545349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cf6fe7b4b6420da1aba08386b72168'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:12.550450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cf6fe7b4b6420da1aba08386b72168'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:12.553861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cf6fe7b4b6420da1aba08386b72168'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:12.598206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cf6fe7b4b6420da1aba08386b72168'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:12.616449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cf6fe7b4b6420da1aba08386b72168'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:12.619821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:12.635570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb46a5a-85c3-4f93-bbc6-e0f5df0a2bd3 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:12.648916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:12.652101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:12.654781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:12.656012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:12.662075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:12.667046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1132/2264] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:12 2022] DELETE /identity/v3/users/39cf6fe7b4b6420da1aba08386b72168 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:49:12.693120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:12.695243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235a16e-cc7a-4391-97ea-9695362b48f6 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:12.759583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1133/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:49:13.176944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:13.178918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:13.397601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:13.398092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:13.398744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:13.529277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] MFA Rules not processed for user `abc8760b6e4a4b1e88f8e20f43073292`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:13.531753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:13.642402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e64da-82c7-4158-a80b-3bc391999e68 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:13.697675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:13.699679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:13.704091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:13.705716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] PATH_INFO: `/v3/projects/0a2be5bcecb342acafacdf5bb6d00bd0` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:13.722645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2be5bcecb342acafacdf5bb6d00bd0)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:13.760328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:13.894906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:14.020531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1134/2266] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:14.104127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2be5bcecb342acafacdf5bb6d00bd0', 'request_id': 'req-36130420-320b-471f-9d3d-ac2cd5b9caf5'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.130478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2be5bcecb342acafacdf5bb6d00bd0', 'request_id': 'req-36130420-320b-471f-9d3d-ac2cd5b9caf5'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.165533 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2be5bcecb342acafacdf5bb6d00bd0', 'request_id': 'req-36130420-320b-471f-9d3d-ac2cd5b9caf5'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.235447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] The token cache is being invalidate because project 0a2be5bcecb342acafacdf5bb6d00bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:14.238467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.242604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.249424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1133/2267] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:13 2022] DELETE /identity/v3/projects/0a2be5bcecb342acafacdf5bb6d00bd0 => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:14.253373 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:14.304198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3beaef-24af-4fc5-ae40-73bd3ca8ac0d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:14.365816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:14.560205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:14.562150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:14.562150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:14.562532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] PATH_INFO: `/v3/users/1fdbd6dcbe184b47ac15ab2090926a36` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:14.564613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdbd6dcbe184b47ac15ab2090926a36)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:14.568525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:14.664798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdbd6dcbe184b47ac15ab2090926a36'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.679670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdbd6dcbe184b47ac15ab2090926a36'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.681546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdbd6dcbe184b47ac15ab2090926a36'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.692954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdbd6dcbe184b47ac15ab2090926a36'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.713855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-8dac17ea-28b2-4aac-8767-3dc483bee6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdbd6dcbe184b47ac15ab2090926a36'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:14.722507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1135/2268] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:14 2022] DELETE /identity/v3/users/1fdbd6dcbe184b47ac15ab2090926a36 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:15.399421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:15.402498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:15.434033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36130420-320b-471f-9d3d-ac2cd5b9caf5 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:15.691619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:15.695802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:15.696701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:15.697457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] PATH_INFO: `/v3/projects/852d4cd9f5d9465b890d9d385f9676f4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:15.700167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=852d4cd9f5d9465b890d9d385f9676f4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:15.705412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:15.820253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852d4cd9f5d9465b890d9d385f9676f4', 'request_id': 'req-f9b16375-e379-4473-afb4-d8c8cc5fff4a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:15.830586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852d4cd9f5d9465b890d9d385f9676f4', 'request_id': 'req-f9b16375-e379-4473-afb4-d8c8cc5fff4a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:15.849052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852d4cd9f5d9465b890d9d385f9676f4', 'request_id': 'req-f9b16375-e379-4473-afb4-d8c8cc5fff4a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:15.890903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] The token cache is being invalidate because project 852d4cd9f5d9465b890d9d385f9676f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:15.891443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:15.902531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f9b16375-e379-4473-afb4-d8c8cc5fff4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:15.904448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1134/2269] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:15 2022] DELETE /identity/v3/projects/852d4cd9f5d9465b890d9d385f9676f4 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:15.913586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:15.919020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:15.921558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.072453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:16.074073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:16.232773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1136/2270] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:16.243211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.244380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.245017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.306317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:16.307614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:16.331989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1135/2271] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:16.336946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.351055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b69d-fd22-4059-b73b-74cbd838be21 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:16.360055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:16.361704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.362444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.363206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.364689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:49:16.365629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:16.369063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:16.393722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1137/2272] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:49:16.397733 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.410575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677cef2-0932-4436-8eec-6f9750e2f278 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:16.455344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:16.456433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.457200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.457857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.459553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:16.464266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:16.535381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1136/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:16 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:16.536296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.561061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8649b9-af81-4c13-a7e8-f5f20106d288 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:16.591224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:16.739526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:16.740649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.741129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.741541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.742760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:16.748406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:16.823118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1138/2274] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:16 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:16.824781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.841608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbbe0-98a3-4dcd-a0f5-73e74226a5aa admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:16.857455 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:16.858241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.858522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.858795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.859679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:16.862069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:16.864025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:16.884624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1137/2275] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:49:16.886277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.914734 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da44496-d19a-4a0f-9e96-9a6b3c7ca009 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:16.925454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:16.935531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:16.936468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:16.937856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:16.939004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:16.942727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5c6a3-d927-41e4-bb58-521549e357de admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:16.976391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1139/2276] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:49:16.980075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:16.999753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eef5b2-7734-440e-a760-8a264da11563 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:17.018245 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:17.019535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:17.020014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:17.020667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] PATH_INFO: `/v3/projects/761147937aa54ab1a5ef1de2834eada4/users/4f7435268b06405f92159d89026d55bc/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:17.066116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761147937aa54ab1a5ef1de2834eada4, user_id=4f7435268b06405f92159d89026d55bc, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:17.073588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:17.139790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1138/2277] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:16 2022] PUT /identity/v3/projects/761147937aa54ab1a5ef1de2834eada4/users/4f7435268b06405f92159d89026d55bc/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:17.140775 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:17.141314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:17.141804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:17.235838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] MFA Rules not processed for user `4f7435268b06405f92159d89026d55bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:17.237114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:17.412771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1140/2278] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:17.441558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:17.444320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:17.547870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7b69a-b2ad-4b0e-a8f8-22fc89889f28 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:17.568534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:17.569547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:17.569835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:17.573293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:17.596379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:17.596650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958d0b1-d051-4460-849f-864daa11c153 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:17.609580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1139/2279] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:49:21.083497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:21.360520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af612d3a-821d-423d-945e-a7d3fe44eda9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:21.369302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:21.371908 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:21.372603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:21.374972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] PATH_INFO: `/v3/users/4f7435268b06405f92159d89026d55bc` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:21.377884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7435268b06405f92159d89026d55bc)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:21.381629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:21.420266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:21.459691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7435268b06405f92159d89026d55bc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:21.475261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7435268b06405f92159d89026d55bc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:21.476467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7435268b06405f92159d89026d55bc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:21.498636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7435268b06405f92159d89026d55bc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:21.516604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7435268b06405f92159d89026d55bc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:21.527871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1141/2280] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:21 2022] DELETE /identity/v3/users/4f7435268b06405f92159d89026d55bc => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:21.532784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:21.533708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:21.534307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:21.556274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:21.558191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:21.678151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1140/2281] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:21.722634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:21.726255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:21.945425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe475b-028b-4407-afaf-9e71397073ea admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:21.961283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:21.961982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:21.962370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:21.962656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:21.982769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:21.984524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491276a-8f36-40b7-93c6-0c637a3a7b4b service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:22.001443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1142/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:22.793747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:22.797041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:22.815225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1c92-1de1-4903-9c19-4a3d2506843c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:22.840203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:22.842193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:22.842920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:22.843604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] PATH_INFO: `/v3/projects/761147937aa54ab1a5ef1de2834eada4` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:22.850284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=761147937aa54ab1a5ef1de2834eada4)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:22.852410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:22.942958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761147937aa54ab1a5ef1de2834eada4', 'request_id': 'req-be7f7960-f447-443b-96a8-ae07d339a8cf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:22.960839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761147937aa54ab1a5ef1de2834eada4', 'request_id': 'req-be7f7960-f447-443b-96a8-ae07d339a8cf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:22.969084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761147937aa54ab1a5ef1de2834eada4', 'request_id': 'req-be7f7960-f447-443b-96a8-ae07d339a8cf'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:22.982563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:22.989030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] The token cache is being invalidate because project 761147937aa54ab1a5ef1de2834eada4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:22.990004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:22.992222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:23.019768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1141/2283] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:22 2022] DELETE /identity/v3/projects/761147937aa54ab1a5ef1de2834eada4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:23.145546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3144-c84c-4b1f-b7d6-afda06037b5d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:23.147102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3144-c84c-4b1f-b7d6-afda06037b5d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:23.156743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc3144-c84c-4b1f-b7d6-afda06037b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:23.206211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-54dc3144-c84c-4b1f-b7d6-afda06037b5d None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:23.207997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-54dc3144-c84c-4b1f-b7d6-afda06037b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:23.323315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1143/2284] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:49:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:23.340775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:23.342398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:23.444852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f7960-f447-443b-96a8-ae07d339a8cf admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:23.450432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:23.451124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:23.451488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:23.451875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:23.462782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:23.464972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:23.477384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1142/2285] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:49:28.686376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d70a-fe8f-499d-bdbd-e96f17b88339 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:28.687356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d70a-fe8f-499d-bdbd-e96f17b88339 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:28.687517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d70a-fe8f-499d-bdbd-e96f17b88339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:28.735883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f316d70a-fe8f-499d-bdbd-e96f17b88339 None None] MFA Rules not processed for user `ad680eeeb787420d9bb421abdb42201a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:28.737516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f316d70a-fe8f-499d-bdbd-e96f17b88339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:28.772920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:28.826351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1144/2286] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:29.253189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:29.254817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:29.334104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1375f-5028-4ad9-93db-5f13159762c6 service swift] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:29.338930 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:29.339836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:29.340121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:29.340393 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] PATH_INFO: `/v3/users/2955886bb30d45efa747a761d75f9c11` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:29.341648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2955886bb30d45efa747a761d75f9c11)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:29.343929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:29.419379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2955886bb30d45efa747a761d75f9c11'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:29.420451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2955886bb30d45efa747a761d75f9c11'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:29.421439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2955886bb30d45efa747a761d75f9c11'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:29.431322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2955886bb30d45efa747a761d75f9c11'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:29.442032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2955886bb30d45efa747a761d75f9c11'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:29.462684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1143/2287] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:29 2022] DELETE /identity/v3/users/2955886bb30d45efa747a761d75f9c11 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:29.468818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:29.469312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:29.469686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:29.491269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:29.492392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:29.573930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1145/2288] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:29.588104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:29.589721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:29.602792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:29.722014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b833fba-a261-4093-8f05-d31e7f2d1b7f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:29.732188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:29.733333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:29.733814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:29.734365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:29.755899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:29.759779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:29.794586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1144/2289] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:30.182921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:30.184765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:30.201146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779cc9e-a077-4549-a2d7-8e961d2c7691 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:30.215325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:30.217186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:30.217475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:30.217762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] PATH_INFO: `/v3/projects/35222e343cd342d0b0c68e60da9c5765` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:30.231241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35222e343cd342d0b0c68e60da9c5765)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:30.245316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:30.350319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35222e343cd342d0b0c68e60da9c5765', 'request_id': 'req-f128fde9-f85f-4aa1-83de-13570dd0b232'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.359379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35222e343cd342d0b0c68e60da9c5765', 'request_id': 'req-f128fde9-f85f-4aa1-83de-13570dd0b232'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.367694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35222e343cd342d0b0c68e60da9c5765', 'request_id': 'req-f128fde9-f85f-4aa1-83de-13570dd0b232'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.472309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] The token cache is being invalidate because project 35222e343cd342d0b0c68e60da9c5765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:30.472605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.473444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.476503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1146/2290] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:30 2022] DELETE /identity/v3/projects/35222e343cd342d0b0c68e60da9c5765 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:30.481135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:30.494276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85cee7-632d-4367-a1e6-dd1d36445a4c service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:30.595715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:30.596701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:30.596985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:30.597321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] PATH_INFO: `/v3/users/89502f2cc4f64be8bc633a13188a054e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:30.598642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=89502f2cc4f64be8bc633a13188a054e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:30.600857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:30.670452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89502f2cc4f64be8bc633a13188a054e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.671132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89502f2cc4f64be8bc633a13188a054e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.671904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89502f2cc4f64be8bc633a13188a054e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.680464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89502f2cc4f64be8bc633a13188a054e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.689212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-eaf94129-ebd2-49c2-81db-8516aa8e0ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89502f2cc4f64be8bc633a13188a054e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:30.716784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1145/2291] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:30 2022] DELETE /identity/v3/users/89502f2cc4f64be8bc633a13188a054e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:31.045763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.048709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:31.066812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128fde9-f85f-4aa1-83de-13570dd0b232 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.189566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.190753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.191091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.191468 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] PATH_INFO: `/v3/projects/7c410fa22ce345ea84b40406834a08c5` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.193450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c410fa22ce345ea84b40406834a08c5)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.195902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.198643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:31.307507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c410fa22ce345ea84b40406834a08c5', 'request_id': 'req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:31.317077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c410fa22ce345ea84b40406834a08c5', 'request_id': 'req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:31.338769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c410fa22ce345ea84b40406834a08c5', 'request_id': 'req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:31.362773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] The token cache is being invalidate because project 7c410fa22ce345ea84b40406834a08c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:31.362992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:31.363718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-622bb126-3d4c-4b71-bbeb-8e9b7b983bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:31.367872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1147/2292] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:31 2022] DELETE /identity/v3/projects/7c410fa22ce345ea84b40406834a08c5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:31.372674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.373221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.373654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.405994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:31.408534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:31.459288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:31.498434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1146/2293] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:31.506041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.506332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.506613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.526509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:31.527721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:31.537361 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1148/2294] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:31.542955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.555190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6398-473e-4b79-a6f4-39e07460e32b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.559935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.560611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.560893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.561169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.561910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:49:31.562275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.563875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.579082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1147/2295] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:49:31.583605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.594487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d53ff-773a-4507-99ce-abda004d5154 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.600966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.608855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.608855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.608855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.609769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.612040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.664888 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1149/2296] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:31 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:31.665130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.678312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399a8ec-f2cb-42ba-9d62-7af6cd23a346 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.781396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.782212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.782568 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.782929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.783712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.785860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.818396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1148/2297] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:31 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:31.823475 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.835380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ebe4a-f654-4318-8493-87f55558c7f4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.841457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.842198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.842484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.842760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.843501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.845234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.866343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1150/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:31.871500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.887600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc15ef-390b-4b17-8540-06f2b50e473b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.896794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.900479 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.900661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.900845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.901687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.903677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060312b0-e051-4430-af6d-812087868c08 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:31.927262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1149/2299] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:31.928930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:31.948078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1faae-daba-4224-98bc-81be51fa279d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:31.956964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:31.957925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:31.958252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:31.958522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] PATH_INFO: `/v3/projects/ae18313b96e34b5caa076a24f0aa1c59/users/b06b5c11d14649c099a862f1282af726/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:31.978227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18313b96e34b5caa076a24f0aa1c59, user_id=b06b5c11d14649c099a862f1282af726, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:31.980971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.002483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1151/2300] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:31 2022] PUT /identity/v3/projects/ae18313b96e34b5caa076a24f0aa1c59/users/b06b5c11d14649c099a862f1282af726/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:32.014290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.014582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.014835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.048554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] MFA Rules not processed for user `b06b5c11d14649c099a862f1282af726`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:32.049890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:32.121857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1150/2301] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:32.126252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.213318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885884-71c2-4cb4-ab51-bd71cf2ca244 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.242179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.243616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.243991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.244278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.245022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.247429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.290652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1152/2302] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:32 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:32.296158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.322262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f8392-5dda-4c52-8f1c-6f6ad9313b6f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.366143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:32.457855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.460905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.461704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.462623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.464590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.468748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.514076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1151/2303] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:32 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:32.517928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.543738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dc65e-a384-4d8f-ad03-d2ab2e04f8e1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.543738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.543738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.543738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.544622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.544622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.544622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.553019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:32.563128 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1153/2304] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:49:32.571427 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.581961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceda5a-ed3b-4323-b9bb-9e6f09172afa admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.588689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.590570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.590984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.591332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] PATH_INFO: `/v3/projects/310a747ee2cf4f24a14eedd03c4b0195/users/5b525d485d124be48cba2ee0efafaf2f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.623276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310a747ee2cf4f24a14eedd03c4b0195, user_id=5b525d485d124be48cba2ee0efafaf2f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.626251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.664598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1152/2305] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:32 2022] PUT /identity/v3/projects/310a747ee2cf4f24a14eedd03c4b0195/users/5b525d485d124be48cba2ee0efafaf2f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:32.668931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.694515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111f14-f09a-4267-978c-66008208ec9e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.830692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.831984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.832470 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.832954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.835404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.838397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5b7cb-bd49-49d2-952c-418accfee0b9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.866529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1154/2306] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:32.882029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:32.896706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b616-d451-462c-8dbb-0cbca2060906 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:32.897981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:32.899152 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.899504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.899786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] PATH_INFO: `/v3/projects/310a747ee2cf4f24a14eedd03c4b0195/users/5b525d485d124be48cba2ee0efafaf2f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.902058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310a747ee2cf4f24a14eedd03c4b0195, user_id=5b525d485d124be48cba2ee0efafaf2f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:32.905447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:32.929739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1153/2307] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:32 2022] PUT /identity/v3/projects/310a747ee2cf4f24a14eedd03c4b0195/users/5b525d485d124be48cba2ee0efafaf2f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:32.934460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:32.934760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:32.935000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:32.988968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] MFA Rules not processed for user `5b525d485d124be48cba2ee0efafaf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:32.990674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:33.106653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1155/2308] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:33.121435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:33.123866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:33.255195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80c25d-a319-4120-a317-83a6283e7da2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:33.260126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:33.260787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:33.261067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:33.261346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:33.273191 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:33.274713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:33.286558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1154/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:33.331738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:33.333247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:33.348101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f01f88-c69e-42e7-9d72-989359c1d8c0 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:33.351944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:33.352613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:33.352894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:33.353170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:33.420686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:33.422171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5b868-07cd-403d-ad55-f8de1bc26a50 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:33.431790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1156/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:37.437546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:37.514159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbb718-269c-425a-9287-f85958e1d3ad service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:37.520099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:37.521041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:37.522421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:37.522421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] PATH_INFO: `/v3/users/b06b5c11d14649c099a862f1282af726` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:37.523089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06b5c11d14649c099a862f1282af726)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:37.525372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:37.527602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:37.611719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06b5c11d14649c099a862f1282af726'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:37.612337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06b5c11d14649c099a862f1282af726'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:37.613032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06b5c11d14649c099a862f1282af726'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:37.632079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06b5c11d14649c099a862f1282af726'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:37.638702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06b5c11d14649c099a862f1282af726'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:37.663230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1155/2311] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:37 2022] DELETE /identity/v3/users/b06b5c11d14649c099a862f1282af726 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:37.671897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:37.672552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:37.672872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:37.704218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:37.705465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:37.720365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:37.781455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1157/2312] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:37.795012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:37.796977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:37.871391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d707-ff9f-4716-a5fb-fe846b06e8b9 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:37.875206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:37.875947 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:37.876298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:37.876638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:37.887132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:37.888605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:37.904390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1156/2313] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:38.386925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:38.388799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:38.402967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030f3b-305d-43a9-8cf6-4dbe67ea3be2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:38.408738 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:38.409735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:38.410114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:38.410458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] PATH_INFO: `/v3/projects/ae18313b96e34b5caa076a24f0aa1c59` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:38.411793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae18313b96e34b5caa076a24f0aa1c59)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:38.414057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:38.471106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae18313b96e34b5caa076a24f0aa1c59', 'request_id': 'req-d2dbb8d0-ce9e-4750-9517-358b953a9199'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.477639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae18313b96e34b5caa076a24f0aa1c59', 'request_id': 'req-d2dbb8d0-ce9e-4750-9517-358b953a9199'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.484139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae18313b96e34b5caa076a24f0aa1c59', 'request_id': 'req-d2dbb8d0-ce9e-4750-9517-358b953a9199'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.498840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] The token cache is being invalidate because project ae18313b96e34b5caa076a24f0aa1c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:38.499129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.499873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.501483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1158/2314] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:38 2022] DELETE /identity/v3/projects/ae18313b96e34b5caa076a24f0aa1c59 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:38.505706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:38.516575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209444-ae3c-44f8-be22-e8e78986bc6e service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:38.593885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:38.595198 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:38.595583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:38.596011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] PATH_INFO: `/v3/users/5b525d485d124be48cba2ee0efafaf2f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:38.597515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b525d485d124be48cba2ee0efafaf2f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:38.599598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:38.644938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:38.708433 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b525d485d124be48cba2ee0efafaf2f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.710199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b525d485d124be48cba2ee0efafaf2f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.717999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b525d485d124be48cba2ee0efafaf2f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.729819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b525d485d124be48cba2ee0efafaf2f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.743011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-968358bf-7607-4c5a-bc76-acdfc0623ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b525d485d124be48cba2ee0efafaf2f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:38.799122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1157/2315] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:38 2022] DELETE /identity/v3/users/5b525d485d124be48cba2ee0efafaf2f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:40.254646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.256972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:40.308917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb8d0-ce9e-4750-9517-358b953a9199 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.392548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.394076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.394472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.394921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] PATH_INFO: `/v3/projects/310a747ee2cf4f24a14eedd03c4b0195` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.397416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310a747ee2cf4f24a14eedd03c4b0195)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.401728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:40.493157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:40.498810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310a747ee2cf4f24a14eedd03c4b0195', 'request_id': 'req-b10be189-fa21-43f2-8a4e-122181e47089'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:40.507114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310a747ee2cf4f24a14eedd03c4b0195', 'request_id': 'req-b10be189-fa21-43f2-8a4e-122181e47089'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:40.518588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310a747ee2cf4f24a14eedd03c4b0195', 'request_id': 'req-b10be189-fa21-43f2-8a4e-122181e47089'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:40.536821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] The token cache is being invalidate because project 310a747ee2cf4f24a14eedd03c4b0195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:40.537263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:40.538127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b10be189-fa21-43f2-8a4e-122181e47089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:40.540260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1159/2316] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:40 2022] DELETE /identity/v3/projects/310a747ee2cf4f24a14eedd03c4b0195 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:40.545251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.546081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.546521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.574238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:40.575522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:40.652900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1158/2317] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:40.661907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.662626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.662978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.687194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:40.688464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:40.699170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1160/2318] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:40.704039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.715732 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b5972-c8a6-449e-83ce-1223b60b7e9e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.721092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.721780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.722087 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.722407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.723085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:49:40.723390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.725731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:40.738458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1159/2319] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:49:40.743277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.754139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae777-7081-49fb-a0f6-5fb28b945599 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.764270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.765267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.765707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.766157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.767084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.769285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:40.801240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1161/2320] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:40 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:40.805400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.817585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35124f99-dbb6-4995-b87e-dcb891bcbac1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.896500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.897373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.897822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.898148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.899014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.901144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:40.924001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1160/2321] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:40 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:40.928277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.939235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66d85-963b-422d-b513-4040e866c270 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.948472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.949166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.949449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.949725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.950614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.952208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:40.963805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1162/2322] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:40.968079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:40.979008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af03-f444-45a3-82f5-661082037e7e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:40.984723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:40.985399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:40.985674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:40.985954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:40.986699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:40.988485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e06988-6547-42e4-af10-2b066962a5ab admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.001026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1161/2323] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:41.006144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.016787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9c20-7616-4a8d-ba57-33e1054222c1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.021711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.022627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.022930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.023234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] PATH_INFO: `/v3/projects/bbeb236cd47c4a818ac370bd37c88871/users/97d8acf8bd8f44d9ab9a76a5ebedb908/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.038553 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbeb236cd47c4a818ac370bd37c88871, user_id=97d8acf8bd8f44d9ab9a76a5ebedb908, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.041230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.058362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1163/2324] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:41 2022] PUT /identity/v3/projects/bbeb236cd47c4a818ac370bd37c88871/users/97d8acf8bd8f44d9ab9a76a5ebedb908/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:41.069727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.070139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.070646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.088335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:41.106261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] MFA Rules not processed for user `97d8acf8bd8f44d9ab9a76a5ebedb908`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:41.107552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:41.180906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1162/2325] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:41.186101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.252612 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afee49-b7ca-4d21-b780-6f87b548ddb2 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.258741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.259419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.259701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.259974 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.260673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.262665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.292323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1164/2326] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:41.296660 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.310857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c00169-8fcd-4c90-9d0f-930c3440fbf0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.376458 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.377158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.377447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.377727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.378880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.380641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.403531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1163/2327] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:41.407725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.418840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd426a8-a421-4c92-9575-754a2f311125 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.424458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.425351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.425649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.425916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.426679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.428482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.443849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1165/2328] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:41.445233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.456440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b6ded-5c2c-4d91-8c60-b8adfe25c24c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.463961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.464752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.465034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.465312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.466158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.467814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.495091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1164/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:41.499898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.515482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50d142-8f0c-460c-808c-52169ce593c8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.523328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.524285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.524759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.524893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] PATH_INFO: `/v3/projects/7114f23aa9e040bdb8cbf60790251759/users/467be7cb90724553b2b29e4a0b801f2f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.542840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7114f23aa9e040bdb8cbf60790251759, user_id=467be7cb90724553b2b29e4a0b801f2f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.545905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf169-47dc-4638-adde-f6ac18ea0956 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.562334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.563137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1166/2330] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:41 2022] PUT /identity/v3/projects/7114f23aa9e040bdb8cbf60790251759/users/467be7cb90724553b2b29e4a0b801f2f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:41.567250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:41.575395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.575689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.575972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.634121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] MFA Rules not processed for user `467be7cb90724553b2b29e4a0b801f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:41.635886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:41.648961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:41.752748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:41.771784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1167/2331] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:41.775820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b27a-dc73-45c8-9927-bd38d0e1361f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.777192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:41.916943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa1333-1786-4c2b-9668-5e8d32e067ab None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:41.922299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.922965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.923291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.923520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:41.923661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.924469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:41.925104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:41.925531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:41.925647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:41.926519 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.930061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.942051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:41.946924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:41.963677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1165/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:41.979586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1168/2333] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:41.984377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.000356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af39d7a-d844-4140-a553-116177a9c548 service placement] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.065872 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.067192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.067477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.067920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.068747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.070843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.093614 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1166/2334] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:41 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:42.097659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.113069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125ec8-d880-4314-aad8-7fe95583a50c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.119571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.120316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.120599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.120876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.122430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.124051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.179704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1169/2335] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:42.184263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.199820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d1389-89be-49c6-ac63-d31030ae2c0c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.206292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.207222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.207507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.207787 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] PATH_INFO: `/v3/projects/22c82d99d9434d469f061e28ab496b56/users/696a97bf1d0a419d8812f8173a90dc8f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.241368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c82d99d9434d469f061e28ab496b56, user_id=696a97bf1d0a419d8812f8173a90dc8f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.244196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.262044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1167/2336] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:42 2022] PUT /identity/v3/projects/22c82d99d9434d469f061e28ab496b56/users/696a97bf1d0a419d8812f8173a90dc8f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:42.265019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.275882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d26301-c55e-4342-b678-916b6cdcd392 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.388038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.388745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.389011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.389284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.390059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.391682 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef3b6e-8aab-410b-b139-f4d0a6c2ea55 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.403345 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1170/2337] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:42.408218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.422195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f3354-8075-416e-99c5-2ccd87700355 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.430696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.431880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.432166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.432539 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] PATH_INFO: `/v3/projects/22c82d99d9434d469f061e28ab496b56/users/696a97bf1d0a419d8812f8173a90dc8f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.434922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c82d99d9434d469f061e28ab496b56, user_id=696a97bf1d0a419d8812f8173a90dc8f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.437429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.458052 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1168/2338] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:42 2022] PUT /identity/v3/projects/22c82d99d9434d469f061e28ab496b56/users/696a97bf1d0a419d8812f8173a90dc8f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:42.469999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.470295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.470574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.502143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] MFA Rules not processed for user `696a97bf1d0a419d8812f8173a90dc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:42.503387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:42.514226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:42.586800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1171/2339] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:42.600899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:42.602737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:42.646876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:42.663828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92377f7f-54e7-45ee-8404-1899f688c6ab admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:42.668572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:42.669225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:42.669506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:42.669795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:42.681470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:42.682974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27683545-2baa-4de3-9c45-8828b740e689 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:42.693838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1169/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:49:43.275632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:43.277402 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:43.292724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4c90-b375-49fd-849d-dd5c0776b9d2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:43.299351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:43.300025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:43.300304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:43.300577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:43.401726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:43.403314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c048-a4e2-4782-b5a8-de72425fce0a service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:43.416216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1172/2341] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:43.965729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:43.966812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:43.966812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:43.968005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1170/2342] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:49:43.974574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39a51-8f0a-4768-b73b-581215411085 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:43.975189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39a51-8f0a-4768-b73b-581215411085 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:43.975477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab39a51-8f0a-4768-b73b-581215411085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.073268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2ab39a51-8f0a-4768-b73b-581215411085 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:44.074922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2ab39a51-8f0a-4768-b73b-581215411085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:44.169869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1173/2343] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:49:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:44.182986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:44.184950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:44.274963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401439-d8a8-4b5e-a6be-9d7e5ae13c9a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:44.278449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:44.279099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.279381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.280004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.291579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:44.293206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45d903-9175-43bc-8dd1-29af0160f6ba service glance] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:44.306011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1171/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:49:44.389518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.390165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.390165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.391855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1174/2345] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:49:44.398946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887d78-7be0-462a-a59f-d2a23caaa4f5 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.399233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887d78-7be0-462a-a59f-d2a23caaa4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.399507 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89887d78-7be0-462a-a59f-d2a23caaa4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.419432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-89887d78-7be0-462a-a59f-d2a23caaa4f5 None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:44.420711 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-89887d78-7be0-462a-a59f-d2a23caaa4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:44.488556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1172/2346] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:49:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:44.501261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:44.503069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:44.511892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:44.518805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82805-2f90-49f1-b8d1-54f32566d7be None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:44.524280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:44.525117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.525667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.526085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.534323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:44.535879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf6493-a3a7-4ac2-82c7-ed45051951db service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:44.544837 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1175/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:44.664057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32979-1a54-4306-bb45-bdc294d8eb76 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.664536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32979-1a54-4306-bb45-bdc294d8eb76 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.664899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32979-1a54-4306-bb45-bdc294d8eb76 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.666653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1173/2348] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 28 17:49:44.672661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.673078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.673595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.694507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:44.696000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:44.713983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1176/2349] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:49:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:44.721247 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32979-1a54-4306-bb45-bdc294d8eb76 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:44.734773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32979-1a54-4306-bb45-bdc294d8eb76 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:44.739250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:44.740053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:44.740330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:44.740601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:44.756513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:44.758214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189b3a-7595-4050-9509-4a14556589b2 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:44.773859 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1174/2350] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:48.177574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:48.189289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69c5d-fa67-4477-a35d-046fe4ffbf14 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:48.196801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:48.197818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:48.198311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:48.198751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:48.280687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:48.282203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:48.292773 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1177/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:50.437718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:50.438469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:50.438469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:50.463273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:50.464894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:50.568979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1175/2352] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:50.603603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:50.606223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:50.626140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ed777-cfaa-4939-88ab-b228d78e341f service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:50.657284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:50.659601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:50.660512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:50.661229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:50.686190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:50.688160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:50.730756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1178/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:51.400945 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:51.409992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:51.419211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ccbc4-cb38-42b1-938b-d5aaea45c74a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:51.424327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:51.425224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:51.425508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:51.426019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:51.428652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:51.514290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:51.517910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232eb28f-7308-4cef-a7ac-ec36022461e1 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:51.529047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:51.529748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1176/2354] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:51.540190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25a32-9468-4f36-aa86-60365500454e service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:51.545670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:51.546884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:51.547085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:51.547753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] PATH_INFO: `/v3/users/97d8acf8bd8f44d9ab9a76a5ebedb908` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:51.550041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d8acf8bd8f44d9ab9a76a5ebedb908)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:51.555718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:51.634655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d8acf8bd8f44d9ab9a76a5ebedb908'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:51.642902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d8acf8bd8f44d9ab9a76a5ebedb908'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:51.643698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d8acf8bd8f44d9ab9a76a5ebedb908'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:51.653805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d8acf8bd8f44d9ab9a76a5ebedb908'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:51.671575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d8acf8bd8f44d9ab9a76a5ebedb908'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:51.680289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1179/2355] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:51 2022] DELETE /identity/v3/users/97d8acf8bd8f44d9ab9a76a5ebedb908 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:51.684849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:51.685132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:51.685411 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:51.711616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:51.712913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:51.821624 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1177/2356] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:51.834964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:51.838623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:51.916704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:51.938067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a185c-165b-466f-a1d0-882367b7a7b8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:51.941973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:51.942928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:51.943212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:51.943488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:51.958251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:51.960346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:51.978176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1180/2357] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:52.565562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:52.570490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:52.604745 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa2505-97aa-48b4-acae-2a0399fa07c0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:52.619357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:52.620343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:52.620753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:52.621242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] PATH_INFO: `/v3/projects/bbeb236cd47c4a818ac370bd37c88871` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:52.623737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbeb236cd47c4a818ac370bd37c88871)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:52.627663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:52.715262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbeb236cd47c4a818ac370bd37c88871', 'request_id': 'req-737782ed-1ad0-4265-a933-3d1ee4b66260'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.729349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbeb236cd47c4a818ac370bd37c88871', 'request_id': 'req-737782ed-1ad0-4265-a933-3d1ee4b66260'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.745812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbeb236cd47c4a818ac370bd37c88871', 'request_id': 'req-737782ed-1ad0-4265-a933-3d1ee4b66260'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.787423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] The token cache is being invalidate because project bbeb236cd47c4a818ac370bd37c88871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:52.788050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.789047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.791117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1178/2358] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:52 2022] DELETE /identity/v3/projects/bbeb236cd47c4a818ac370bd37c88871 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:52.795732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:52.807090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e519-990e-41b8-aa5d-9dd8865c246e service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:52.892245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:52.893477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:52.893842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:52.894215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] PATH_INFO: `/v3/users/467be7cb90724553b2b29e4a0b801f2f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:52.895564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467be7cb90724553b2b29e4a0b801f2f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:52.897796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:52.946232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467be7cb90724553b2b29e4a0b801f2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.953136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467be7cb90724553b2b29e4a0b801f2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.953979 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467be7cb90724553b2b29e4a0b801f2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.964223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467be7cb90724553b2b29e4a0b801f2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.980449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467be7cb90724553b2b29e4a0b801f2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:52.987683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1181/2359] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:52 2022] DELETE /identity/v3/users/467be7cb90724553b2b29e4a0b801f2f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:49:53.544627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:53.546603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:53.596658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737782ed-1ad0-4265-a933-3d1ee4b66260 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:53.620830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:53.699713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:53.703422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:53.704290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:53.705006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] PATH_INFO: `/v3/projects/7114f23aa9e040bdb8cbf60790251759` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:53.716934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7114f23aa9e040bdb8cbf60790251759)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:53.721980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:53.867284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7114f23aa9e040bdb8cbf60790251759', 'request_id': 'req-c6926706-489a-4153-9588-96801f533c96'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:53.880323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7114f23aa9e040bdb8cbf60790251759', 'request_id': 'req-c6926706-489a-4153-9588-96801f533c96'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:53.891124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7114f23aa9e040bdb8cbf60790251759', 'request_id': 'req-c6926706-489a-4153-9588-96801f533c96'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:53.926720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] The token cache is being invalidate because project 7114f23aa9e040bdb8cbf60790251759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:53.927028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:53.928025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c6926706-489a-4153-9588-96801f533c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:53.937924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1179/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:53 2022] DELETE /identity/v3/projects/7114f23aa9e040bdb8cbf60790251759 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:49:53.938180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:53.941575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:53.958545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595891fc-f9b2-4e85-a1fc-0b120eb47786 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:54.037779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:54.039083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:54.039368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:54.039641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] PATH_INFO: `/v3/users/696a97bf1d0a419d8812f8173a90dc8f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:54.041140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696a97bf1d0a419d8812f8173a90dc8f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:54.043410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:54.047309 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:54.106624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696a97bf1d0a419d8812f8173a90dc8f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:54.117314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696a97bf1d0a419d8812f8173a90dc8f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:54.118231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696a97bf1d0a419d8812f8173a90dc8f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:54.127920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696a97bf1d0a419d8812f8173a90dc8f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:54.146434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696a97bf1d0a419d8812f8173a90dc8f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:54.157913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1182/2361] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:49:53 2022] DELETE /identity/v3/users/696a97bf1d0a419d8812f8173a90dc8f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:54.902742 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:54.906394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:54.907046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:54.921501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:54.924844 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:54.984351 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:54.985468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:55.073395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e449-ab3b-4d68-ab94-8975fb1a9de4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:55.082808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:55.085244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.086297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.087405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] PATH_INFO: `/v3/projects/22c82d99d9434d469f061e28ab496b56` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.090834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c82d99d9434d469f061e28ab496b56)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:55.094163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:55.123693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1180/2362] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:49:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:55.156628 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:55.160737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:55.247415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c82d99d9434d469f061e28ab496b56', 'request_id': 'req-248dcb05-070b-42a1-829f-d4e9db22a8e9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:55.264933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.283642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c82d99d9434d469f061e28ab496b56', 'request_id': 'req-248dcb05-070b-42a1-829f-d4e9db22a8e9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:55.310512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c82d99d9434d469f061e28ab496b56', 'request_id': 'req-248dcb05-070b-42a1-829f-d4e9db22a8e9'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:55.343170 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] The token cache is being invalidate because project 22c82d99d9434d469f061e28ab496b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:49:55.343568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:55.344348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-248dcb05-070b-42a1-829f-d4e9db22a8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:49:55.353164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1183/2363] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:49:54 2022] DELETE /identity/v3/projects/22c82d99d9434d469f061e28ab496b56 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:55.355026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd701-cdd9-425c-b361-70b792ae4577 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.360791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd701-cdd9-425c-b361-70b792ae4577 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.361344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd701-cdd9-425c-b361-70b792ae4577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.408275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-eb8fd701-cdd9-425c-b361-70b792ae4577 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:55.411999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-eb8fd701-cdd9-425c-b361-70b792ae4577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:55.427115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:55.477255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bacd32-c710-4e9b-a847-85375b2175e9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:55.589078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1184/2364] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:55.600831 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.603441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.604042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.642159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:55.642439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:55.643548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.644296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.644463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:55.645814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.651360 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:55.662061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1185/2365] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:55.664529 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:55.678318 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d402b-bf86-48ff-8869-7f3b7af5e1b8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:55.685074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:55.685692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.686088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.686428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.687207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:49:55.687517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:55.689335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:55.706781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1186/2366] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:49:55.712757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:55.726996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1c68c-4440-46dc-b87a-32dcdfb7dc90 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:55.734849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:55.735710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.736215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.736585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.738010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:55.740750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:55.800861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1187/2367] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:55 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:55.807367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:55.843246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:55.847994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be732-7487-4262-a5d5-27da2f6fb28a service swift] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:55.882541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1181/2368] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:49:55.950762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:55.952046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:55.952471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:55.985670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:55.987151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:56.003968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add867c-b976-44a1-a0f4-dabe8fc0c2ae admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:56.008592 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1182/2369] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:56.012296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:56.013860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.014397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.014842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.015767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:56.020049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:56.048043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:56.049964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:56.085711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1188/2370] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:55 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:56.088277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:56.140983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336e72-9abc-48ad-8af2-56e1446d88fd admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:56.154900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:56.171035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:56.172140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.173764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.175618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.181710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:56.187604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:56.220512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5f635-4193-47e9-a236-16e06cf08bda None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:56.234968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1189/2371] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:56.237537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:56.239998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:56.240976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.241263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.241546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.261725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:56.264147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:56.268820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac7ba0-f3c7-4226-aad4-bcd7db13d474 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:56.279812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1183/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:49:56.285610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:56.287000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.288504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.288929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.290008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:56.294577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164ec2-96c1-47fa-b801-b07843bc0cf3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:56.322558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1190/2373] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:56.324621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:56.335885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a07921-093a-4f34-8378-e5fbfb34017b service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:56.350768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:56.351901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.352437 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.352825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] PATH_INFO: `/v3/projects/b736d5bdb26b436f94ac0a5cb502e4ed/users/b1ebdb9066394d15b8865ce05acca4d1/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.392846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b736d5bdb26b436f94ac0a5cb502e4ed, user_id=b1ebdb9066394d15b8865ce05acca4d1, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:56.398649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:56.489419 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1184/2374] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:56 2022] PUT /identity/v3/projects/b736d5bdb26b436f94ac0a5cb502e4ed/users/b1ebdb9066394d15b8865ce05acca4d1/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:49:56.538570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:56.538854 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:56.539123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:56.603566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] MFA Rules not processed for user `b1ebdb9066394d15b8865ce05acca4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:56.605137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:56.668407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:56.846813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1191/2375] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:49:56.852636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:57.088108 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a762d8e-5366-4989-bd7e-2198b430f43e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:57.096388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:57.097706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:57.098015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:57.098299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:57.099255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:57.103318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:57.175349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1185/2376] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:49:56 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:49:57.179111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:57.195458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7434d-1365-438d-bede-e8cd05247a87 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:57.340875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:57.341727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:57.342072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:57.342398 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:57.343297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:57.345575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:57.389300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1192/2377] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:49:57 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:49:57.396535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:57.425463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bed48-ceae-4f0b-bccb-19656aa24800 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:57.438296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:57.440898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:57.441537 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:57.442454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:57.444084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:57.447892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:57.494491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1186/2378] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:57.501850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:57.525036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d0729-fede-4fa9-8128-d26fb82e2064 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:57.534522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:57.535586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:57.536689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:57.537084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] PATH_INFO: `/v3/projects/8c05e60f3d334333a01e690e0a241599/users/fcb1d312c27f404fb5aa586d9742c988/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:57.600896 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c05e60f3d334333a01e690e0a241599, user_id=fcb1d312c27f404fb5aa586d9742c988, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:57.606268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:57.656315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1193/2379] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:57 2022] PUT /identity/v3/projects/8c05e60f3d334333a01e690e0a241599/users/fcb1d312c27f404fb5aa586d9742c988/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:57.663470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:57.715670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e33ec-48e8-4246-a023-394d79c06e41 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:58.172004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:58.172821 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:58.173133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:58.173428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:58.174841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:58.192181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699bc1-bd4b-4b9f-b0bb-a99688470e6b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:58.220124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1187/2380] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:49:58.250370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:58.276011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621b13f-0ad9-4127-ac65-2d8596ed87ff admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:58.326756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:58.329106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:58.330174 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:58.331146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] PATH_INFO: `/v3/projects/8c05e60f3d334333a01e690e0a241599/users/fcb1d312c27f404fb5aa586d9742c988/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:58.338371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c05e60f3d334333a01e690e0a241599, user_id=fcb1d312c27f404fb5aa586d9742c988, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:58.348834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:58.386937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1194/2381] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:49:58 2022] PUT /identity/v3/projects/8c05e60f3d334333a01e690e0a241599/users/fcb1d312c27f404fb5aa586d9742c988/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:49:58.412636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:58.413819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:58.414288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:58.541269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:49:58.593006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] MFA Rules not processed for user `fcb1d312c27f404fb5aa586d9742c988`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:49:58.608418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:58.895953 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1188/2382] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:49:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:49:58.908520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:49:58.913772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:49:59.163138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cc49-c4d8-476b-8491-3c4ced589657 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:49:59.168076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:49:59.168763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:49:59.169049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:49:59.169324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:49:59.189023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:49:59.191260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322cf04-6f9c-488e-9e62-1b6716d644db service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:49:59.205064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1195/2383] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:49:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:00.972667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:01.227357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67185e4-ce7c-4acc-9875-85ac061f8614 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:01.233113 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:01.234949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:01.235653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:01.236252 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] PATH_INFO: `/v3/users/b1ebdb9066394d15b8865ce05acca4d1` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:01.239420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ebdb9066394d15b8865ce05acca4d1)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:01.247765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:01.374829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ebdb9066394d15b8865ce05acca4d1'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:01.376983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ebdb9066394d15b8865ce05acca4d1'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:01.378737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ebdb9066394d15b8865ce05acca4d1'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:01.400394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ebdb9066394d15b8865ce05acca4d1'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:01.433990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ebdb9066394d15b8865ce05acca4d1'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:01.489453 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1189/2384] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:00 2022] DELETE /identity/v3/users/b1ebdb9066394d15b8865ce05acca4d1 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:01.491910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:01.492497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:01.492883 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:01.555867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:01.571234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:01.618576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:01.858828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:01.861091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:01.881095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1196/2385] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:50:01.918205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:01.996280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045994d-f57b-4efe-bbb3-8870ef01640b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:02.001924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:02.003209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:02.003508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:02.003791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:02.023534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:02.025445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:02.050491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1190/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:50:02.960463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:02.967822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:02.989689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd85f-f60f-43bc-9753-003ae7a3c827 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:03.006216 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:03.007806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:03.008325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:03.009006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] PATH_INFO: `/v3/projects/b736d5bdb26b436f94ac0a5cb502e4ed` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:03.010832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b736d5bdb26b436f94ac0a5cb502e4ed)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:03.013781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:03.126033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b736d5bdb26b436f94ac0a5cb502e4ed', 'request_id': 'req-60b6d356-258c-4c39-9be9-5b006a6c4967'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.139581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b736d5bdb26b436f94ac0a5cb502e4ed', 'request_id': 'req-60b6d356-258c-4c39-9be9-5b006a6c4967'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.155565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b736d5bdb26b436f94ac0a5cb502e4ed', 'request_id': 'req-60b6d356-258c-4c39-9be9-5b006a6c4967'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.202191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] The token cache is being invalidate because project b736d5bdb26b436f94ac0a5cb502e4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:03.202490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.203178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.205325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1197/2387] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:02 2022] DELETE /identity/v3/projects/b736d5bdb26b436f94ac0a5cb502e4ed => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:03.211641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:03.225631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17d3e-135c-4359-867e-8b1e945ff0ac service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:03.401705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:03.402681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:03.403089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:03.403382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] PATH_INFO: `/v3/users/fcb1d312c27f404fb5aa586d9742c988` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:03.405134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb1d312c27f404fb5aa586d9742c988)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:03.407205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:03.480878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb1d312c27f404fb5aa586d9742c988'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.481708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb1d312c27f404fb5aa586d9742c988'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.482349 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb1d312c27f404fb5aa586d9742c988'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.495159 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb1d312c27f404fb5aa586d9742c988'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.507344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-73c1f660-bbd4-4df9-80c5-a94b7d88ba39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb1d312c27f404fb5aa586d9742c988'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:03.548102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1191/2388] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:03 2022] DELETE /identity/v3/users/fcb1d312c27f404fb5aa586d9742c988 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:04.030825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:04.034278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:04.080996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6d356-258c-4c39-9be9-5b006a6c4967 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:04.248421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:04.248421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.248421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.248421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] PATH_INFO: `/v3/projects/8c05e60f3d334333a01e690e0a241599` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.251943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c05e60f3d334333a01e690e0a241599)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:04.254972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:04.343087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:04.345617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c05e60f3d334333a01e690e0a241599', 'request_id': 'req-703b91fa-71dc-4348-a40a-3167787ea113'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:04.359499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c05e60f3d334333a01e690e0a241599', 'request_id': 'req-703b91fa-71dc-4348-a40a-3167787ea113'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:04.369815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c05e60f3d334333a01e690e0a241599', 'request_id': 'req-703b91fa-71dc-4348-a40a-3167787ea113'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:04.393706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] The token cache is being invalidate because project 8c05e60f3d334333a01e690e0a241599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:04.394199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:04.394894 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-703b91fa-71dc-4348-a40a-3167787ea113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:04.397442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1198/2389] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:04 2022] DELETE /identity/v3/projects/8c05e60f3d334333a01e690e0a241599 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:04.402324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.403100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.403100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.423680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:04.425074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:04.474752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:04.544446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1192/2390] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:04.557497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.557791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.558226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.581161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:04.582461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:04.609085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1199/2391] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:50:04.610396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:04.627521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f91c39-ea54-4a8f-9654-dab8659bce98 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:04.636101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:04.637216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.637699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.638164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.639207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:50:04.639629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:04.641656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:04.664303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1193/2392] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:50:04.669772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:04.686298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c7886-8231-4908-a9aa-57e71d3d7d14 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:04.694221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:04.695408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.695699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.696153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.696951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:04.700584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:04.749240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1200/2393] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:50:04 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:04.755333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:04.787639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ac6a-2c04-4b55-85bc-e16a6661c920 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:04.914642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:04.917718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:04.918580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:04.919374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:04.921354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:04.926663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:04.960130 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1194/2394] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:50:04 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:50:04.964500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:04.992899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496d42b-b266-4e38-ba65-c977fde26af9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:04.999264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.000237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.000712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.001095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.002219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.004614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.020223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1201/2395] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:05.025800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.039752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2dae4-a934-4d41-8d09-1a4467cce9ed admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.045487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.046525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.047003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.047451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.048578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.050366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57410307-dd1f-4d98-8a9b-8af1268480b1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.062549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1195/2396] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:05.067506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.079083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927bc13-8dbf-407c-b14d-e9b6c2a6d2ad admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.086464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.088118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.088704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.089261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] PATH_INFO: `/v3/projects/9e2adcd68025443b889481d9b8aec0b6/users/23c629d2597a469983946f9fcc82e668/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.113843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2adcd68025443b889481d9b8aec0b6, user_id=23c629d2597a469983946f9fcc82e668, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.117388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.139825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1202/2397] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:50:05 2022] PUT /identity/v3/projects/9e2adcd68025443b889481d9b8aec0b6/users/23c629d2597a469983946f9fcc82e668/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:50:05.151058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.151354 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.151632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.214110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] MFA Rules not processed for user `23c629d2597a469983946f9fcc82e668`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:05.216307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:05.338952 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1196/2398] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:50:05.343895 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.595836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c610cb-1642-485f-8a7e-c933434ab0b9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.616702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.627048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.627570 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.627987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.629406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.633525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.699565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1203/2399] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:50:05 2022] POST /identity/v3/projects => generated 379 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:05.705318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.748779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c025a8a-43d5-4f4b-a46a-5f98646a795f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.833017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:05.883307 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.884006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.884289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.884571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.885310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.887402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.923464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1197/2400] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:50:05 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:05.924710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.938307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb12d2c-b281-4eeb-b060-028eadbd985e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.945432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.946169 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.946441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.946718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:05.947524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:05.949137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:05.963739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1204/2401] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:50:05.968211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:05.979840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c2002-df97-4c1d-a47e-afe63d7cbb5a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:05.985168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:05.986143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:05.986514 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:05.986797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] PATH_INFO: `/v3/projects/d8a024ea9ca54312821e7007e5d76606/users/a26bf8977cea474da33a0ddad6d9a589/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:06.011608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a024ea9ca54312821e7007e5d76606, user_id=a26bf8977cea474da33a0ddad6d9a589, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:06.015810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:06.035693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1198/2402] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:50:05 2022] PUT /identity/v3/projects/d8a024ea9ca54312821e7007e5d76606/users/a26bf8977cea474da33a0ddad6d9a589/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:06.041092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:06.054271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5bfaa-027e-4e43-9a38-7b96bff171ac admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:06.125830 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:06.143853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:06.144727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:06.145158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:06.145461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:06.146333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:06.148002 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef0e83-6c3d-4c17-b0b5-8342b1674882 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:06.161396 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1205/2403] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:06.166363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:06.183506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd276db-7f19-498c-a440-0a4df62905ca admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:06.195580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:06.197610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:06.198026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:06.198584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] PATH_INFO: `/v3/projects/d8a024ea9ca54312821e7007e5d76606/users/a26bf8977cea474da33a0ddad6d9a589/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:06.202795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a024ea9ca54312821e7007e5d76606, user_id=a26bf8977cea474da33a0ddad6d9a589, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:06.210912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:06.229705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1199/2404] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:50:06 2022] PUT /identity/v3/projects/d8a024ea9ca54312821e7007e5d76606/users/a26bf8977cea474da33a0ddad6d9a589/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:06.243662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:06.244114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:06.244496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:06.283767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] MFA Rules not processed for user `a26bf8977cea474da33a0ddad6d9a589`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:06.285053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:06.394650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1206/2405] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:06.407644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:06.410067 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:06.523528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cb298-7aa6-4287-b062-21de5d3f67ec admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:06.530422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:06.531578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:06.532060 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:06.532552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:06.551241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:06.554535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4e01-1e70-40e2-8bb7-9917cebd1fc5 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:06.586105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1200/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:50:07.119665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:07.199679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4c045-d5df-45f5-afb5-8d7d2f6e6408 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:07.204727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:07.205663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:07.205968 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:07.206260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] PATH_INFO: `/v3/users/23c629d2597a469983946f9fcc82e668` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:07.207494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c629d2597a469983946f9fcc82e668)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:07.209490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:07.272104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c629d2597a469983946f9fcc82e668'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:07.294988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c629d2597a469983946f9fcc82e668'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:07.295938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c629d2597a469983946f9fcc82e668'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:07.310868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c629d2597a469983946f9fcc82e668'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:07.319588 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:07.337171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c629d2597a469983946f9fcc82e668'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:07.351062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1207/2407] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:07 2022] DELETE /identity/v3/users/23c629d2597a469983946f9fcc82e668 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:07.356263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:07.357118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:07.357118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:07.385357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:07.387513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:07.496609 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1201/2408] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:07.507046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:07.508709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:07.592851 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabcd55-661a-43e6-b19f-07dc75c30959 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:07.598533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:07.599006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:07.600315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:07.600315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:07.618009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:07.620041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:07.633877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1208/2409] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:50:07.965133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:07.966653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:07.984813 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc89d26-e550-40e1-a71d-62bb2e64fdab None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:07.990313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:07.990986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:07.991271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:07.991556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] PATH_INFO: `/v3/projects/9e2adcd68025443b889481d9b8aec0b6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:07.992842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2adcd68025443b889481d9b8aec0b6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:07.994827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:08.042224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:08.079713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2adcd68025443b889481d9b8aec0b6', 'request_id': 'req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.085713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2adcd68025443b889481d9b8aec0b6', 'request_id': 'req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.094499 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2adcd68025443b889481d9b8aec0b6', 'request_id': 'req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.122407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] The token cache is being invalidate because project 9e2adcd68025443b889481d9b8aec0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:08.122696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.123361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.125410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1202/2410] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:07 2022] DELETE /identity/v3/projects/9e2adcd68025443b889481d9b8aec0b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:08.130156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:08.155646 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7b78-51a9-4afe-9720-7979323bbf12 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:08.315049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:08.324938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:08.325552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:08.326092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] PATH_INFO: `/v3/users/a26bf8977cea474da33a0ddad6d9a589` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:08.328160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26bf8977cea474da33a0ddad6d9a589)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:08.331122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:08.416658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26bf8977cea474da33a0ddad6d9a589'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.426273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26bf8977cea474da33a0ddad6d9a589'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.427418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26bf8977cea474da33a0ddad6d9a589'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.439665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26bf8977cea474da33a0ddad6d9a589'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.461772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0e5d9e5-01b2-4173-b539-2f4bc2de5944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26bf8977cea474da33a0ddad6d9a589'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:08.470189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1209/2411] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:08 2022] DELETE /identity/v3/users/a26bf8977cea474da33a0ddad6d9a589 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:08.881553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:08.883203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:08.907138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c12d-dd95-4cc5-b74b-0fc2336d57cd admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.002323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.003282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.003575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.003934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] PATH_INFO: `/v3/projects/d8a024ea9ca54312821e7007e5d76606` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.005496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a024ea9ca54312821e7007e5d76606)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.007513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.067998 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a024ea9ca54312821e7007e5d76606', 'request_id': 'req-9f222cdd-da47-447c-903f-9468d3b361fe'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:09.077090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a024ea9ca54312821e7007e5d76606', 'request_id': 'req-9f222cdd-da47-447c-903f-9468d3b361fe'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:09.085010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a024ea9ca54312821e7007e5d76606', 'request_id': 'req-9f222cdd-da47-447c-903f-9468d3b361fe'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:09.109815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] The token cache is being invalidate because project d8a024ea9ca54312821e7007e5d76606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:09.110145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:09.110965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9f222cdd-da47-447c-903f-9468d3b361fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:09.112564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1203/2412] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:08 2022] DELETE /identity/v3/projects/d8a024ea9ca54312821e7007e5d76606 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:09.118307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.118548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.118788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.139595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:09.140840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:09.147532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:09.235149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1210/2413] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:09.245518 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.245808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.246206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.270775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:09.272068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:09.281085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1204/2414] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:09.285684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.296282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c137d7d-0ba6-4d59-9ca5-08007646ac79 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.301302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.302293 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.302644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.302928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.303674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:50:09.303986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.305658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.319300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1211/2415] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:50:09.323818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.333640 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65895653-b124-4d32-a30e-27ab3780c46b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.340407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.341283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.341590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.341876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.342782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.345167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.384585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1205/2416] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:50:09 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:09.390370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.407134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bd86-708f-48d9-a151-151dd9790c4d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.479198 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.479910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.480191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.480469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.481177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.483162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.506332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1212/2417] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:50:09 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:09.510424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.521006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c583b7-6791-4315-9ef2-f3f91a039c75 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.527302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.528064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.528573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.528918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.531536 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.533283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.545630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1206/2418] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:09.549675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.560877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a753c-accd-45e4-814c-bac7af75068f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.566055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.566835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.567050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.567503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.568357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.569866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e283976-e6bd-4870-8e69-6e2172a39220 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.581130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1213/2419] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:09.585675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.592762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:09.599689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879032d6-74f0-4b56-b2f0-fc30b26304b1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.607219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.608649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.609076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.609570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] PATH_INFO: `/v3/projects/21fed20272414c7ab7c6cba061b725fa/users/c40fbbab22d346cb88ddcd3aedecb06f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.625626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fed20272414c7ab7c6cba061b725fa, user_id=c40fbbab22d346cb88ddcd3aedecb06f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.628403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.645528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1207/2420] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:50:09 2022] PUT /identity/v3/projects/21fed20272414c7ab7c6cba061b725fa/users/c40fbbab22d346cb88ddcd3aedecb06f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:09.656548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.656897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.657256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.704923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] MFA Rules not processed for user `c40fbbab22d346cb88ddcd3aedecb06f`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:09.706798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:09.786966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1214/2421] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:09.799934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.803054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:09.874934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38a0d2-e424-4123-8a10-2c43388ed8fb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:09.880961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:09.881722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:09.890369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:09.890369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:09.892839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:09.894528 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308507b-231d-42c3-9f5e-77b16323696a service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:09.914150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1208/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:09.926589 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:09.932418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:10.003087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66945d-d09e-4096-9827-e0f3918915f3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:10.009127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:10.010049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.010347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.010622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] PATH_INFO: `/v3/users/c40fbbab22d346cb88ddcd3aedecb06f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.011967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40fbbab22d346cb88ddcd3aedecb06f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:10.014429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:10.070508 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40fbbab22d346cb88ddcd3aedecb06f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.078050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40fbbab22d346cb88ddcd3aedecb06f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.078759 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40fbbab22d346cb88ddcd3aedecb06f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.087824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40fbbab22d346cb88ddcd3aedecb06f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.101193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40fbbab22d346cb88ddcd3aedecb06f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.108707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1215/2423] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:09 2022] DELETE /identity/v3/users/c40fbbab22d346cb88ddcd3aedecb06f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:10.112402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.112685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.112959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.131719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:10.132941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:10.202332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1209/2424] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:10.212744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:10.214244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:10.276725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06118e3f-e00f-422d-805d-fc9e35b85a20 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:10.280886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:10.281574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.281859 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.282166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.292330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:10.293788 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e923b4-3a8f-4e97-ba78-97d83e9cbb3d service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:10.304542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1216/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:10.602725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:10.604852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:10.625224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b155e-4ff7-413d-8e28-dad7b2dc65ac None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:10.631538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:10.632569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.632846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.633117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] PATH_INFO: `/v3/projects/21fed20272414c7ab7c6cba061b725fa` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.634418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fed20272414c7ab7c6cba061b725fa)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:10.636399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:10.788240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fed20272414c7ab7c6cba061b725fa', 'request_id': 'req-bd73a366-da73-45ce-b4d4-c9ed52f24d33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.798092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fed20272414c7ab7c6cba061b725fa', 'request_id': 'req-bd73a366-da73-45ce-b4d4-c9ed52f24d33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.808088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fed20272414c7ab7c6cba061b725fa', 'request_id': 'req-bd73a366-da73-45ce-b4d4-c9ed52f24d33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.827410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] The token cache is being invalidate because project 21fed20272414c7ab7c6cba061b725fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:10.828175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.829227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bd73a366-da73-45ce-b4d4-c9ed52f24d33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:10.831837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1210/2426] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:10 2022] DELETE /identity/v3/projects/21fed20272414c7ab7c6cba061b725fa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:50:10.838865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.839741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.840030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.867015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:10.869551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:10.904359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:10.959025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1217/2427] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:10.970172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:10.970799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:10.970799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:10.979830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:10.993754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:10.997278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:11.015015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1211/2428] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:11.081755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.094054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc7b06-e3ff-4fd0-a1d3-3b66416c6fac None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.100491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.101338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.101703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.102131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.103056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:50:11.103459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.105329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.119966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1218/2429] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:50:11.125906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.136017 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c893d-6fa5-4cd0-9aa9-a83607e7b5b8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.141011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.141686 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.141991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.142275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.142995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.144894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.178041 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1212/2430] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:50:11 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:11.183289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.195408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf7a1a-bba7-4a7d-9d8f-c779b1195534 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.271731 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.272624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.273004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.273370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.274210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.282013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.300403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1219/2431] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:50:11 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:50:11.305043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.316115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c2f97-948e-424d-badb-e1aafe946f5d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.321158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.321856 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.322175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.322447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.323185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.324812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.337760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1213/2432] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:11.342191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.357669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c952a60-d174-4512-9a46-611b5203ef7c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.363227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.363934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.364330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.364630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.365563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.367269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd663602-69f5-481f-9339-89ebe76428e7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.379633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1220/2433] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:50:11.384806 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.396255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe4d8b-35c7-4efb-861b-7a9627d511cb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.401432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.402408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.402677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.402971 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] PATH_INFO: `/v3/projects/1c958f28d0e7417fb063f50b3f50fd4c/users/8d5df4e4c79a435696fea55f9f5f756b/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.421670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c958f28d0e7417fb063f50b3f50fd4c, user_id=8d5df4e4c79a435696fea55f9f5f756b, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.424418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.441491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1214/2434] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:50:11 2022] PUT /identity/v3/projects/1c958f28d0e7417fb063f50b3f50fd4c/users/8d5df4e4c79a435696fea55f9f5f756b/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:11.453697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcd0c-dc77-4f94-8a8f-7ee0ed8daa10 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.454144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcd0c-dc77-4f94-8a8f-7ee0ed8daa10 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.454482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfcd0c-dc77-4f94-8a8f-7ee0ed8daa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.485583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-05bfcd0c-dc77-4f94-8a8f-7ee0ed8daa10 None None] MFA Rules not processed for user `8d5df4e4c79a435696fea55f9f5f756b`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:11.486626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-05bfcd0c-dc77-4f94-8a8f-7ee0ed8daa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:11.562482 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1221/2435] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:11.574943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:11.576846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:11.647471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f015-0815-49d4-a926-c04bd12fff32 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:11.651227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:11.651925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:11.652200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:11.652471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:11.662905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:11.664409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:11.674551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1215/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:13.188465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:13.189042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:13.189156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:13.209661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:13.210902 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:13.239039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:13.322929 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1222/2437] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:13.419181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:13.420741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:13.538725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2dd3-c02f-4019-9082-a49c88dbd08c service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:13.553094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:13.553895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:13.554278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:13.554621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:13.565365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:13.567147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813b211-4080-4a02-9857-ed4326545c5d service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:13.578878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1216/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:16.080671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:16.082944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:16.148769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64f093-5617-4d92-8ae1-09afab25e060 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:16.152866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:16.153530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:16.153806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:16.154461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:16.156392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:16.233924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:16.235494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:16.247756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1223/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:17.280759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c77d-f8e7-4041-853e-75c4b09db228 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:17.281320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c77d-f8e7-4041-853e-75c4b09db228 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:17.281320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c77d-f8e7-4041-853e-75c4b09db228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:17.304486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8528c77d-f8e7-4041-853e-75c4b09db228 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:17.305679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8528c77d-f8e7-4041-853e-75c4b09db228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:17.315907 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1217/2440] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:17.347587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:17.349872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:17.369334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067d601-84d6-43f0-9ac0-df98fd3cfdc8 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:17.377978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:17.378699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:17.378967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:17.379418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:17.391817 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:17.393820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:17.406815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1224/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:20.703975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb258-15be-4fb3-801f-b7757f908d8d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:20.704512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb258-15be-4fb3-801f-b7757f908d8d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:20.704591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb258-15be-4fb3-801f-b7757f908d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:20.729177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8a0eb258-15be-4fb3-801f-b7757f908d8d None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:20.730531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8a0eb258-15be-4fb3-801f-b7757f908d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:20.749092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:20.798337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1218/2442] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:20.812205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:20.813659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:20.885868 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:20.891613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74396453-7a18-4d3e-baff-93c0c4b3d60d service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:20.897495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:20.898254 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:20.898534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:20.898841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:20.907919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:20.909554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:20.919563 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1225/2443] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:50:21.522055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784edc-b470-468d-9783-a293ea99cd84 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:21.522335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784edc-b470-468d-9783-a293ea99cd84 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:21.522636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784edc-b470-468d-9783-a293ea99cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:21.553421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-16784edc-b470-468d-9783-a293ea99cd84 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:21.555019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-16784edc-b470-468d-9783-a293ea99cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:21.564502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1219/2444] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:21.587988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:21.603910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4320f4b-729b-4b9f-beb3-ec9e3b12fcc8 service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:21.612206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:21.612873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:21.613154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:21.613430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:21.623720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:21.625465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:21.636517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1226/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:24.800498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314ffe-6edd-44ee-9a00-8b9b9221aeab None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:24.800946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314ffe-6edd-44ee-9a00-8b9b9221aeab None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:24.801073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b314ffe-6edd-44ee-9a00-8b9b9221aeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:24.821770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3b314ffe-6edd-44ee-9a00-8b9b9221aeab None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:24.823047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3b314ffe-6edd-44ee-9a00-8b9b9221aeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:24.833290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1220/2446] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:24.861432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:24.874014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ae6b-271f-45ac-be85-d2b7ed27cb3b service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:24.880674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:24.881343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:24.881625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:24.881900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:24.893592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:24.895861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:24.909736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1227/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:34.816270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=21 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:34.902658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=17 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:43.771938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d0d10-2343-4d8b-ac53-335adc86e410 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:43.772669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d0d10-2343-4d8b-ac53-335adc86e410 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:43.776137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d0d10-2343-4d8b-ac53-335adc86e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:43.800222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-521d0d10-2343-4d8b-ac53-335adc86e410 None None] MFA Rules not processed for user `5b0b16370fdf477fa845bf6a1d25d83b`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:43.801572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-521d0d10-2343-4d8b-ac53-335adc86e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:43.871112 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1221/2448] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:50:46.683054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:46.699959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b1e0-da28-46e2-a7f3-5dc327d9d150 service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:46.711079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:46.712616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:46.713050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:46.713537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] PATH_INFO: `/v3/users/8d5df4e4c79a435696fea55f9f5f756b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:46.716052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5df4e4c79a435696fea55f9f5f756b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:46.720601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:46.794578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5df4e4c79a435696fea55f9f5f756b'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:46.804506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5df4e4c79a435696fea55f9f5f756b'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:46.805379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5df4e4c79a435696fea55f9f5f756b'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:46.816507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5df4e4c79a435696fea55f9f5f756b'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:46.844061 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5df4e4c79a435696fea55f9f5f756b'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:46.855971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1228/2449] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:50:46 2022] DELETE /identity/v3/users/8d5df4e4c79a435696fea55f9f5f756b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:46.861131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:46.861980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:46.861980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:46.895588 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:46.896838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:46.988850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1222/2450] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:46.999267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:47.001326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:47.070431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03597a-7cdd-4f99-a67f-81c4cf441ba9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:47.076651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:47.077732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:47.078305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:47.078793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:47.094944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:47.097557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b86c7-2ddc-47ed-b545-7d8a32c86386 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:47.115157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1229/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:50:47.520288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:47.523708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:47.540583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011f319-6389-495b-94e9-dd6f41548d19 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:47.552413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:47.554362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:47.554870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:47.556177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] PATH_INFO: `/v3/projects/1c958f28d0e7417fb063f50b3f50fd4c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:47.558162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c958f28d0e7417fb063f50b3f50fd4c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:47.560492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:47.621701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c958f28d0e7417fb063f50b3f50fd4c', 'request_id': 'req-24745169-42cf-44b5-b315-5be1cbb56573'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:47.628662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c958f28d0e7417fb063f50b3f50fd4c', 'request_id': 'req-24745169-42cf-44b5-b315-5be1cbb56573'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:47.636578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c958f28d0e7417fb063f50b3f50fd4c', 'request_id': 'req-24745169-42cf-44b5-b315-5be1cbb56573'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:47.652703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] The token cache is being invalidate because project 1c958f28d0e7417fb063f50b3f50fd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:50:47.653030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:47.654065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:50:47.655713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1223/2452] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:50:47 2022] DELETE /identity/v3/projects/1c958f28d0e7417fb063f50b3f50fd4c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:50:57.107537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:57.649616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:50:58.272707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564daa-4a5a-4bd5-bb0d-49b01c4c2d2a None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:58.273270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564daa-4a5a-4bd5-bb0d-49b01c4c2d2a None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:58.273270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564daa-4a5a-4bd5-bb0d-49b01c4c2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:58.294368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-dd564daa-4a5a-4bd5-bb0d-49b01c4c2d2a None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:50:58.295622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-dd564daa-4a5a-4bd5-bb0d-49b01c4c2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:58.364088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1230/2453] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:50:58.385826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:50:58.387471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:50:58.472673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24745169-42cf-44b5-b315-5be1cbb56573 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:50:58.478318 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:50:58.478997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:50:58.479280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:50:58.479554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:50:58.489900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:50:58.491918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:50:58.502670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1224/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:02.574945 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6214f5-706b-4363-a23a-4e327cd4a1a2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:02.575510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6214f5-706b-4363-a23a-4e327cd4a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:02.575510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6214f5-706b-4363-a23a-4e327cd4a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:02.601113 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7d6214f5-706b-4363-a23a-4e327cd4a1a2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:02.603016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7d6214f5-706b-4363-a23a-4e327cd4a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:02.612454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1231/2455] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:02.638955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:02.651657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e50dc-b944-4322-beee-0481aab44a0f service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:02.658371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:02.659097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:02.659376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:02.659661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:02.671280 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:02.673309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:02.688395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1225/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:05.648073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d493-e7e2-4468-a7ad-0005e947bc61 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:05.648745 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d493-e7e2-4468-a7ad-0005e947bc61 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:05.648846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d493-e7e2-4468-a7ad-0005e947bc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:05.676634 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9141d493-e7e2-4468-a7ad-0005e947bc61 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:05.677869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9141d493-e7e2-4468-a7ad-0005e947bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:05.689616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1232/2457] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:05.716995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:05.719353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:05.741390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f046802-26b8-4411-b2de-ec146a39e341 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:05.748023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:05.748616 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:05.748904 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:05.749183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:05.759326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:05.763014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:05.778997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1226/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:08.864723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efca5a-da77-4e30-92b2-462cff8ec51d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:08.865647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efca5a-da77-4e30-92b2-462cff8ec51d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:08.865827 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efca5a-da77-4e30-92b2-462cff8ec51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:08.887622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-48efca5a-da77-4e30-92b2-462cff8ec51d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:08.888879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-48efca5a-da77-4e30-92b2-462cff8ec51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:08.897809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1233/2459] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:08.928197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:08.940488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67cc81-7178-4262-8506-e2616b94f0d8 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:08.947269 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:08.947946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:08.948229 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:08.948505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:08.958739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:08.960741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:08.973282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1227/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:12.041017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556a32-1d0a-4e84-bf3e-44840f3a6667 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:12.041657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556a32-1d0a-4e84-bf3e-44840f3a6667 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:12.041657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556a32-1d0a-4e84-bf3e-44840f3a6667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:12.062329 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ab556a32-1d0a-4e84-bf3e-44840f3a6667 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:12.063579 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ab556a32-1d0a-4e84-bf3e-44840f3a6667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:12.074391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1234/2461] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Jun 28 17:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:12.099321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:12.113362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14815c17-ab40-41bd-bc33-95d4d409f2f8 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:12.119408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:12.120076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:12.120355 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:12.120613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:12.130619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:12.132706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3dbec-4043-4ec7-b8d3-00904efe66be service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:12.144525 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1228/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:19.134297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:19.134925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:19.134925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:19.155544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] MFA Rules not processed for user `ad680eeeb787420d9bb421abdb42201a`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:19.156789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:19.228366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1235/2463] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:51:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:22.138928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=58 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:29.220965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=64 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:32.449076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9b80-1156-41a2-b6c0-fa3157ac3ece None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:32.449658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9b80-1156-41a2-b6c0-fa3157ac3ece None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:32.449658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e9b80-1156-41a2-b6c0-fa3157ac3ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:32.469736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-637e9b80-1156-41a2-b6c0-fa3157ac3ece None None] MFA Rules not processed for user `832905930aa14f328e0d87f424afbaea`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:32.471068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-637e9b80-1156-41a2-b6c0-fa3157ac3ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:32.535131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1229/2464] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:51:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:37.028922 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:37.030753 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:37.126511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ce69-d0e0-4a28-b58f-4c9a5d02d5ff None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:37.144965 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:37.145785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:37.146203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:37.146721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:37.149600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:37.168281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:37.170286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:37.187389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1236/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:38.130965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:38.133450 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:38.133976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:38.173867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] MFA Rules not processed for user `b8215c04115a40c4b6f8eeebc53206d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:51:38.175466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:38.263560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1230/2466] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:51:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:51:38.720973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:38.725303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:38.737897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353de91a-ac71-44a3-8c58-7b82f6a87e46 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:38.744336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:38.745091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:38.745410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:38.745889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:38.749670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:38.768374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:38.770295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:38.783839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1237/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:51:48.255342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=50 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:48.778090 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=32 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:51:52.009377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:52.010885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:51:52.029598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe895d42-d062-4c1e-9860-8298395249e7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:52.035385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:52.036320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:52.036829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:52.037744 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] PATH_INFO: `/v3/users/5b0b16370fdf477fa845bf6a1d25d83b` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:52.039403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0b16370fdf477fa845bf6a1d25d83b)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:52.041583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:52.108653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0b16370fdf477fa845bf6a1d25d83b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.109617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0b16370fdf477fa845bf6a1d25d83b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.110242 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0b16370fdf477fa845bf6a1d25d83b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.119418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0b16370fdf477fa845bf6a1d25d83b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.129033 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0b16370fdf477fa845bf6a1d25d83b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.150908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1231/2468] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:51:52 2022] DELETE /identity/v3/users/5b0b16370fdf477fa845bf6a1d25d83b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:51:52.409131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:51:52.423659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a1267-ca40-4d3e-af0a-e1d066caf4e7 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:51:52.493799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:51:52.495107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:51:52.495581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:51:52.495858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] PATH_INFO: `/v3/projects/e26786d227be4c2c943740b406bfaa03` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:51:52.497173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26786d227be4c2c943740b406bfaa03)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:51:52.499559 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:51:52.553390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26786d227be4c2c943740b406bfaa03', 'request_id': 'req-b7ee0ec5-c817-4134-a614-ec489af96e70'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.563593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26786d227be4c2c943740b406bfaa03', 'request_id': 'req-b7ee0ec5-c817-4134-a614-ec489af96e70'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.573298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26786d227be4c2c943740b406bfaa03', 'request_id': 'req-b7ee0ec5-c817-4134-a614-ec489af96e70'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.595452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] The token cache is being invalidate because project e26786d227be4c2c943740b406bfaa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:51:52.596098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.597281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b7ee0ec5-c817-4134-a614-ec489af96e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:51:52.600391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1238/2469] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:51:52 2022] DELETE /identity/v3/projects/e26786d227be4c2c943740b406bfaa03 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:02.146716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:02.589611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:08.955650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:08.957205 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:09.041303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed77ec1-809a-475e-afbb-45b5bf748202 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:09.120421 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:09.121086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:09.121369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:09.121645 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:09.124137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:09.196771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:09.198409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:09.209448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1232/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:17.130983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:17.132069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:17.132069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:17.164322 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:17.165722 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:17.229437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1239/2471] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:52:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:52:17.290395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:17.291920 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:17.340869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:17.373526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09621-e616-4f5f-87d4-d2e059e7f769 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:17.378984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:17.379650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:17.379934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:17.380210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:17.389058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:17.390713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:17.401580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1233/2472] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:52:25.004097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:25.005862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:25.071438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:25.071950 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:25.087879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9633e6c-f11e-4c3d-829c-6b98834396a1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:25.093712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:25.094816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:25.094967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:25.095247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:25.097408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:25.111225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:25.112891 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:25.124818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1240/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:25.146300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1675-8647-4693-9427-167888a1a83b service swift] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:25.151128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:25.152399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:25.152677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:25.152986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] PATH_INFO: `/v3/users/abc8760b6e4a4b1e88f8e20f43073292` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:25.154371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc8760b6e4a4b1e88f8e20f43073292)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:25.156527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:25.219100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc8760b6e4a4b1e88f8e20f43073292'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.219875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc8760b6e4a4b1e88f8e20f43073292'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.220513 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc8760b6e4a4b1e88f8e20f43073292'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.229212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc8760b6e4a4b1e88f8e20f43073292'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.237828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc8760b6e4a4b1e88f8e20f43073292'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.256117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1234/2474] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:25 2022] DELETE /identity/v3/users/abc8760b6e4a4b1e88f8e20f43073292 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:25.438982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:25.452195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f62cb4-21a6-4998-a6c2-03c2b4dfb714 service placement] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:25.521210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:25.522303 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:25.522576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:25.522944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] PATH_INFO: `/v3/projects/9ccd7db4353348a6b60cc7006968c93d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:25.524256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccd7db4353348a6b60cc7006968c93d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:25.526225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:25.569833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:25.581516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccd7db4353348a6b60cc7006968c93d', 'request_id': 'req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.589499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccd7db4353348a6b60cc7006968c93d', 'request_id': 'req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.598038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccd7db4353348a6b60cc7006968c93d', 'request_id': 'req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.612458 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] The token cache is being invalidate because project 9ccd7db4353348a6b60cc7006968c93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:25.612746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.613400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.615055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1241/2475] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:25 2022] DELETE /identity/v3/projects/9ccd7db4353348a6b60cc7006968c93d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:25.619677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:25.621352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:25.638598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01f0a8-224a-4ccd-91bb-8f66377340bb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:25.691800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:25.711809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:25.712709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:25.712985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:25.713260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] PATH_INFO: `/v3/users/ae3124b095444da9bab8796c751557c6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:25.714482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3124b095444da9bab8796c751557c6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:25.716476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:25.767308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3124b095444da9bab8796c751557c6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.767979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3124b095444da9bab8796c751557c6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.768831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3124b095444da9bab8796c751557c6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.775887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3124b095444da9bab8796c751557c6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.786011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3124b095444da9bab8796c751557c6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:25.804611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1235/2476] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:25 2022] DELETE /identity/v3/users/ae3124b095444da9bab8796c751557c6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:26.008861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:26.010467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:26.036642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e28df-d0d1-43a7-b5bd-2c48b3e52fb1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:26.105704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:26.106624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:26.106909 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:26.107185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] PATH_INFO: `/v3/projects/1c684aa085324aed9e7deb7271ec64a9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:26.108387 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c684aa085324aed9e7deb7271ec64a9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:26.110530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:26.165925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c684aa085324aed9e7deb7271ec64a9', 'request_id': 'req-3f478a9a-e865-4ac5-9fa0-45fa80965c59'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:26.172492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c684aa085324aed9e7deb7271ec64a9', 'request_id': 'req-3f478a9a-e865-4ac5-9fa0-45fa80965c59'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:26.179240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c684aa085324aed9e7deb7271ec64a9', 'request_id': 'req-3f478a9a-e865-4ac5-9fa0-45fa80965c59'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:26.194252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] The token cache is being invalidate because project 1c684aa085324aed9e7deb7271ec64a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:26.194434 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:26.195059 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:26.196872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1242/2477] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:26 2022] DELETE /identity/v3/projects/1c684aa085324aed9e7deb7271ec64a9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:28.073520 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:28.075071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:28.164179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba097d-2db2-49f2-b8e7-43b5fa6dd223 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:28.229208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:28.243852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:28.245600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:28.247071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:28.247995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:28.256584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:28.341136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:28.342731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:28.354611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1236/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:28.865317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:28.867222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:28.885366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f478a9a-e865-4ac5-9fa0-45fa80965c59 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:28.893258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:28.894401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:28.894916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:28.895320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:28.897581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:28.916021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:28.917680 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:28.930696 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1243/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:30.668697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:30.670399 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:30.734901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81bfe7-e5dd-4059-aa37-c93e73cc1306 service nova] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:30.738727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:30.739379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:30.739657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:30.739919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:30.741759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:30.804284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:30.816190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc431e-f2d4-4f9e-ba4a-e682877404a1 service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:30.822549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:30.823232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:30.823516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:30.823679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:30.823869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:30.825412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:30.825715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:30.838597 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1237/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:30.875143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:30.897811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:30.899511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:30.910235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1244/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:35.153049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:35.154993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:35.183970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd200-4b2d-424d-9d63-4eed1c85f3ff service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:35.191199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:35.192406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.192702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.193111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] PATH_INFO: `/v3/users/ad680eeeb787420d9bb421abdb42201a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.195324 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad680eeeb787420d9bb421abdb42201a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:35.198982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:35.291270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:35.295212 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad680eeeb787420d9bb421abdb42201a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.296721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad680eeeb787420d9bb421abdb42201a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.298049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad680eeeb787420d9bb421abdb42201a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.307673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad680eeeb787420d9bb421abdb42201a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.320471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-34e872cd-f78f-420c-9373-d1050d39f3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad680eeeb787420d9bb421abdb42201a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.354466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1238/2482] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:35 2022] DELETE /identity/v3/users/ad680eeeb787420d9bb421abdb42201a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:35.585062 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:35.597444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8e246-007e-4d66-b92c-4cb439a9c7af service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:35.674720 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:35.675670 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.675948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.676223 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] PATH_INFO: `/v3/projects/5f47c829c3cf4ae08a074953911d5f13` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.677438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f47c829c3cf4ae08a074953911d5f13)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:35.679388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:35.733514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f47c829c3cf4ae08a074953911d5f13', 'request_id': 'req-4f184669-d723-4f78-a1ef-531a4c21ecdc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.740479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f47c829c3cf4ae08a074953911d5f13', 'request_id': 'req-4f184669-d723-4f78-a1ef-531a4c21ecdc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.747527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f47c829c3cf4ae08a074953911d5f13', 'request_id': 'req-4f184669-d723-4f78-a1ef-531a4c21ecdc'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.761966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] The token cache is being invalidate because project 5f47c829c3cf4ae08a074953911d5f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:35.762272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.762969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-4f184669-d723-4f78-a1ef-531a4c21ecdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:35.764590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1245/2483] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:35 2022] DELETE /identity/v3/projects/5f47c829c3cf4ae08a074953911d5f13 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:35.770404 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.770699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.770975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.792851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:35.793724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:35.868288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1239/2484] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:35.877200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.877610 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.877886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.902118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:35.903523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:35.917667 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1246/2485] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:52:35.918913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:35.930248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3718f47-876f-43a3-a12d-fad35288c115 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:35.938898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:35.938898 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.939245 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.939342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.940074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:52:35.940384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:35.942131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:35.955749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1240/2486] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:52:35.960364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:35.971142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de92e-1089-49e5-a890-b50fa0493f10 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:35.977718 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:35.978462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:35.978855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:35.979140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:35.979878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:35.982229 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.015226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1247/2487] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:35 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:36.019606 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.032598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d274-60a6-4c25-99db-9d9143044d46 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.144761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.145503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.145795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.146339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.148401 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.151065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.176885 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1241/2488] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:36 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:36.181145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.193603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc0ddc-1fba-4c0d-ae6c-81edd4f147bd admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.198857 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.199536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.199804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.200092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.200832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.202496 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.214889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1248/2489] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:36.220552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.232847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3b871-340e-4971-a095-9146adb505eb admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.238074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.238948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.239330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.239695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.240541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.242434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c145a-527f-49f2-91ab-739c31f7acb3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.255789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1242/2490] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:52:36.259757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.270998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b78ef-6958-4f07-90a3-71ef8d1bcd93 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.278107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.279263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.279683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.280146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] PATH_INFO: `/v3/projects/479b338ab5e943dd925c0fa0d0d185f4/users/418872b96c8340e0b709dcf681405874/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.304076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479b338ab5e943dd925c0fa0d0d185f4, user_id=418872b96c8340e0b709dcf681405874, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.306938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.325704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1249/2491] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:36 2022] PUT /identity/v3/projects/479b338ab5e943dd925c0fa0d0d185f4/users/418872b96c8340e0b709dcf681405874/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:36.336400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.336772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.337073 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.368684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] MFA Rules not processed for user `418872b96c8340e0b709dcf681405874`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:36.369897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:36.386046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:36.444612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1243/2492] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:36.449114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.459592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:36.517438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28d23e-11f6-4f4e-b77f-f31d13290694 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.522834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.523590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.523890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.524257 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.525100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.527555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.558370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1250/2493] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:36 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:36.562869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.576102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9216-bb33-429a-8707-1af2f3efdee4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.649157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.650951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.651386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.652182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.653405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.658965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.687424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1244/2494] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:36 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:36.688998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.700594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04224206-1da7-42ad-940f-54f021c53a39 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.706450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.707600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.708092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.708513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.709664 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.712573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.731633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1251/2495] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:36.737337 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.749741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1986eb60-16ae-41a1-bab7-7f7b5213751a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.755079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.756477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.756764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.757043 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] PATH_INFO: `/v3/projects/0e7d5ea2be9b47849a537690b025b2e2/users/39df7624f67b403e921e296b52951f41/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.780709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d5ea2be9b47849a537690b025b2e2, user_id=39df7624f67b403e921e296b52951f41, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.783534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.798812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1245/2496] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:36 2022] PUT /identity/v3/projects/0e7d5ea2be9b47849a537690b025b2e2/users/39df7624f67b403e921e296b52951f41/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:36.803275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.814545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702054-9416-45b1-837d-12a61e8e26d5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.875880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.876586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.876869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.877140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.877876 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.879540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257c489-163f-4863-b800-62aaddffb75d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.890264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1252/2497] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:52:36.894841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:36.908473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca236cb7-ca2c-434c-bc7d-a1b9c7e967dc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:36.914328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:36.915395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.915395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.915691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] PATH_INFO: `/v3/projects/0e7d5ea2be9b47849a537690b025b2e2/users/39df7624f67b403e921e296b52951f41/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.917746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d5ea2be9b47849a537690b025b2e2, user_id=39df7624f67b403e921e296b52951f41, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:36.920470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:36.933182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1246/2498] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:36 2022] PUT /identity/v3/projects/0e7d5ea2be9b47849a537690b025b2e2/users/39df7624f67b403e921e296b52951f41/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:36.945332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:36.945792 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:36.946221 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:36.978614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] MFA Rules not processed for user `39df7624f67b403e921e296b52951f41`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:36.979918 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:37.067474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1253/2499] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:37.076855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:37.079291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:37.158612 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36314461-943a-4c58-9375-f115ffb2f1aa admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:37.167384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:37.167384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:37.167887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:37.167887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:37.182431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:37.184274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:37.200169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1247/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:37.316564 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:37.319531 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:37.338889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:37.356008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2165d4d-0dae-4498-92ef-c0052ccac545 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:37.366442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:37.367239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:37.367636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:37.367957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:37.459822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:37.461295 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b4df8-6f29-40e3-8bab-f9f1f6f1a22c service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:37.473643 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1254/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:44.653801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:44.671968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:44.761562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b00e-00f7-4f47-b990-85548b432dd9 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:44.772317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:44.773509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:44.773908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:44.774348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] PATH_INFO: `/v3/users/418872b96c8340e0b709dcf681405874` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:44.777791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418872b96c8340e0b709dcf681405874)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:44.781543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:44.873407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418872b96c8340e0b709dcf681405874'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:44.874595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418872b96c8340e0b709dcf681405874'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:44.875654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418872b96c8340e0b709dcf681405874'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:44.894402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418872b96c8340e0b709dcf681405874'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:44.904569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418872b96c8340e0b709dcf681405874'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:44.928932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1248/2502] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:44 2022] DELETE /identity/v3/users/418872b96c8340e0b709dcf681405874 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:44.934259 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:44.934702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:44.934822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:44.956439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:44.957657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:45.024724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1255/2503] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:52:45.035723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:45.037716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:45.118913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dd3fe-ab82-4017-a42e-6c9fe13a1ec9 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:45.123408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:45.124069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:45.124376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:45.124649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:45.136302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:45.137759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:45.148464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1249/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:45.446736 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:45.448239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:45.461227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f28af-de98-46b6-993f-c04538b5fc8f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:45.469874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:45.471024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:45.471437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:45.471833 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] PATH_INFO: `/v3/projects/479b338ab5e943dd925c0fa0d0d185f4` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:45.473661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479b338ab5e943dd925c0fa0d0d185f4)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:45.475760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:45.528535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479b338ab5e943dd925c0fa0d0d185f4', 'request_id': 'req-41a4e21d-14ff-47fb-8c8d-0cd711655373'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.535047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479b338ab5e943dd925c0fa0d0d185f4', 'request_id': 'req-41a4e21d-14ff-47fb-8c8d-0cd711655373'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.542748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479b338ab5e943dd925c0fa0d0d185f4', 'request_id': 'req-41a4e21d-14ff-47fb-8c8d-0cd711655373'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.573705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] The token cache is being invalidate because project 479b338ab5e943dd925c0fa0d0d185f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:45.574040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.574977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.576585 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1256/2505] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:45 2022] DELETE /identity/v3/projects/479b338ab5e943dd925c0fa0d0d185f4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:45.580938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:45.591179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67a91-3998-4dc3-9bc2-78c2034a2fcb service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:45.624466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:45.656701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:45.657590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:45.657870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:45.658168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] PATH_INFO: `/v3/users/39df7624f67b403e921e296b52951f41` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:45.659370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] RBAC: Authorizing `identity:delete_user(user_id=39df7624f67b403e921e296b52951f41)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:45.661300 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:45.715717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39df7624f67b403e921e296b52951f41'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.716454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39df7624f67b403e921e296b52951f41'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.716973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39df7624f67b403e921e296b52951f41'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.725081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39df7624f67b403e921e296b52951f41'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.735361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-2b6e2d34-bbf7-492a-91ca-77ad621afeed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39df7624f67b403e921e296b52951f41'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:45.755941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1250/2506] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:45 2022] DELETE /identity/v3/users/39df7624f67b403e921e296b52951f41 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:46.107164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.108666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.121962 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4e21d-14ff-47fb-8c8d-0cd711655373 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.156576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:46.211375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.212425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.213017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.213017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] PATH_INFO: `/v3/projects/0e7d5ea2be9b47849a537690b025b2e2` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.214308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7d5ea2be9b47849a537690b025b2e2)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.216416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.275454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7d5ea2be9b47849a537690b025b2e2', 'request_id': 'req-f0917e06-d7ed-4e5d-a939-bd117a510287'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:46.280800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7d5ea2be9b47849a537690b025b2e2', 'request_id': 'req-f0917e06-d7ed-4e5d-a939-bd117a510287'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:46.288016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7d5ea2be9b47849a537690b025b2e2', 'request_id': 'req-f0917e06-d7ed-4e5d-a939-bd117a510287'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:46.303981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] The token cache is being invalidate because project 0e7d5ea2be9b47849a537690b025b2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:46.304200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:46.305063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:46.307179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1257/2507] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:46 2022] DELETE /identity/v3/projects/0e7d5ea2be9b47849a537690b025b2e2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:46.314896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef85a-a50d-4643-aa8a-47bc9354c051 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.315208 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef85a-a50d-4643-aa8a-47bc9354c051 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.315490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ef85a-a50d-4643-aa8a-47bc9354c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.334120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-137ef85a-a50d-4643-aa8a-47bc9354c051 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:46.335385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-137ef85a-a50d-4643-aa8a-47bc9354c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.400731 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.402818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.405408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:46.413826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.414149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.414432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.438776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:46.440076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.449188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1252/2509] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:46.455339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.465183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118c687-9a7c-4cd6-b1fd-95d8dd596865 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.469854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.470556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.470840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.471117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.471846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:52:46.472156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.473759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.481326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0917e06-d7ed-4e5d-a939-bd117a510287 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.485614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.486118 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1253/2510] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:52:46.486310 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.486591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.486863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.488651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.490164 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.499017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.500136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c8c61-58a7-49a1-b36c-046e6a73654a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.500671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.505642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.506343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.506625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.506896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.507580 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.509157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1258/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:46.509471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.554489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1254/2512] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:46.555636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.568022 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbcc0a-a0e8-4653-8aad-43deecd33ba1 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.626375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:46.633577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.634375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.634835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.635359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.636504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.638688 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.662471 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1259/2513] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:46.666474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.672465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:46.678894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda832f-ca25-4b2c-9cbb-4ff7c532120f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.686913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.687835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.688077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.688273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.689115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.690899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.705125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1255/2514] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:46.706456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.717115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d562ea-26cd-42dd-9382-9b5d2108505f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.723106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.723799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.724669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.724669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.725070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.726735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5120f4-8833-4486-b4cc-0998a9c96f89 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.738327 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1260/2515] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:46.742652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.753840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7cc5b-e720-4711-901d-0b006bcc2631 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:46.759189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:46.760217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.760503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.760781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] PATH_INFO: `/v3/projects/d6628e7afc9e481ea61cdb955fd955e6/users/24feb8adf9284effbaa29f2dde68489d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.777807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6628e7afc9e481ea61cdb955fd955e6, user_id=24feb8adf9284effbaa29f2dde68489d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:46.780531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:46.796135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1256/2516] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:46 2022] PUT /identity/v3/projects/d6628e7afc9e481ea61cdb955fd955e6/users/24feb8adf9284effbaa29f2dde68489d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:46.807874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:46.808086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:46.808374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:46.837055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] MFA Rules not processed for user `24feb8adf9284effbaa29f2dde68489d`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:46.838306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:46.912756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1261/2517] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:46.917563 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:46.995781 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f700a-d75a-4940-bf5d-1f5911eef108 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.001272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.002546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.002546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.002546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.003183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.005099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.039189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1257/2518] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:46 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:47.043726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.060495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99245f0f-33ba-4904-9d31-ea8b8b5317f3 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.143834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.144485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.144702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.144946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.145627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.147669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.171980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1262/2519] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:47 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:47.176202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.187032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02186e-4799-4a54-aabb-7a9f55ab0764 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.192755 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.193434 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.193716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.194028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.194771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.196396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.208765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1258/2520] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:47.212930 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.223713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e08a-3b62-405c-a8ba-2289a7a2442c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.228419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.229324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.229633 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.229926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] PATH_INFO: `/v3/projects/aa793ac4666342d2a459b2fed86b2e68/users/2807ad6f92b04804a345a47b3d371d9f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.245542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa793ac4666342d2a459b2fed86b2e68, user_id=2807ad6f92b04804a345a47b3d371d9f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.248214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.268039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1263/2521] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:47 2022] PUT /identity/v3/projects/aa793ac4666342d2a459b2fed86b2e68/users/2807ad6f92b04804a345a47b3d371d9f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:47.272322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.286943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56f3e3-e0fc-4b1c-b4d8-206320da2b05 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.357218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.357979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.358271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.358552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.359289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.361064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac21a2-6b0a-4e3c-8a14-a187bc0c1b9c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.378760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1259/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:47.380141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.391708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaaa6-f290-4885-ada9-74fd273e1653 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.397010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.397983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.398271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.398566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] PATH_INFO: `/v3/projects/aa793ac4666342d2a459b2fed86b2e68/users/2807ad6f92b04804a345a47b3d371d9f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.400702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa793ac4666342d2a459b2fed86b2e68, user_id=2807ad6f92b04804a345a47b3d371d9f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.403811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.415617 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1264/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:47 2022] PUT /identity/v3/projects/aa793ac4666342d2a459b2fed86b2e68/users/2807ad6f92b04804a345a47b3d371d9f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:47.427170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.427545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.427842 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.463767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] MFA Rules not processed for user `2807ad6f92b04804a345a47b3d371d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:47.465022 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:47.494475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:47.544870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1260/2524] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:47.561365 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.563603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:47.588522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:47.627146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34401d41-1e6c-4481-8347-66faaad6ccd5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.631526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.632181 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.632469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.632747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.643105 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.644557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7a10-35ff-4e24-9f4a-48f28b6600b1 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.657162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1265/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:47.686230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.750367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd1766-b517-45a1-a92a-8e933fd94b56 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:47.755157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:47.756048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.756335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.756610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] PATH_INFO: `/v3/users/24feb8adf9284effbaa29f2dde68489d` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.757837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24feb8adf9284effbaa29f2dde68489d)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:47.760265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:47.815804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24feb8adf9284effbaa29f2dde68489d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:47.816396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24feb8adf9284effbaa29f2dde68489d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:47.816990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24feb8adf9284effbaa29f2dde68489d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:47.823958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24feb8adf9284effbaa29f2dde68489d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:47.832845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24feb8adf9284effbaa29f2dde68489d'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:47.854895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1261/2526] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:47 2022] DELETE /identity/v3/users/24feb8adf9284effbaa29f2dde68489d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:47.860378 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:47.860692 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:47.860992 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:47.883760 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:47.884996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:47.951222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1266/2527] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:47.961855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:47.963429 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:48.011013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:48.025220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46aa5d5-df0b-46a3-adde-57cbf5d2b968 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:48.031621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:48.032474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:48.032931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:48.033270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:48.047292 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:48.048762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:48.059792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1262/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:48.457592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:48.459338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:48.479426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f0046-b788-483e-bd17-5a45b9d7a449 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:48.491900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:48.492818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:48.493095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:48.493401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] PATH_INFO: `/v3/projects/d6628e7afc9e481ea61cdb955fd955e6` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:48.496462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6628e7afc9e481ea61cdb955fd955e6)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:48.498162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:48.562123 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6628e7afc9e481ea61cdb955fd955e6', 'request_id': 'req-a2f183f6-bb40-400e-8c58-f6664481c2f4'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.574999 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6628e7afc9e481ea61cdb955fd955e6', 'request_id': 'req-a2f183f6-bb40-400e-8c58-f6664481c2f4'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.584873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6628e7afc9e481ea61cdb955fd955e6', 'request_id': 'req-a2f183f6-bb40-400e-8c58-f6664481c2f4'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.603210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] The token cache is being invalidate because project d6628e7afc9e481ea61cdb955fd955e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:48.603666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.604410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.606544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1267/2529] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:48 2022] DELETE /identity/v3/projects/d6628e7afc9e481ea61cdb955fd955e6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:48.611949 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:48.624125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80790c-453f-4982-87b5-2eeeaea11889 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:48.694370 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:48.695843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:48.695843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:48.696094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] PATH_INFO: `/v3/users/2807ad6f92b04804a345a47b3d371d9f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:48.697327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2807ad6f92b04804a345a47b3d371d9f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:48.700440 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:48.752761 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2807ad6f92b04804a345a47b3d371d9f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.753658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2807ad6f92b04804a345a47b3d371d9f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.754278 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2807ad6f92b04804a345a47b3d371d9f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.762523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2807ad6f92b04804a345a47b3d371d9f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.773309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-03a58af8-7f5e-4ab6-93e6-d445bbd353be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2807ad6f92b04804a345a47b3d371d9f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:48.796138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1263/2530] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:48 2022] DELETE /identity/v3/users/2807ad6f92b04804a345a47b3d371d9f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:49.123591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.125884 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:49.167763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f183f6-bb40-400e-8c58-f6664481c2f4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.227455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:49.247823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.248938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.249239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.249517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] PATH_INFO: `/v3/projects/aa793ac4666342d2a459b2fed86b2e68` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.251211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa793ac4666342d2a459b2fed86b2e68)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.253636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.308769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa793ac4666342d2a459b2fed86b2e68', 'request_id': 'req-d5703b01-2953-4875-a166-cae3e4796754'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:49.316203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa793ac4666342d2a459b2fed86b2e68', 'request_id': 'req-d5703b01-2953-4875-a166-cae3e4796754'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:49.322568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa793ac4666342d2a459b2fed86b2e68', 'request_id': 'req-d5703b01-2953-4875-a166-cae3e4796754'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:49.336826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] The token cache is being invalidate because project aa793ac4666342d2a459b2fed86b2e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:49.337111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:49.337730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-d5703b01-2953-4875-a166-cae3e4796754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:49.339317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1268/2531] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:49 2022] DELETE /identity/v3/projects/aa793ac4666342d2a459b2fed86b2e68 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:49.344798 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.345176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.345698 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.365376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:49.367466 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:49.448331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1264/2532] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:49.450607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.450921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.451186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.471675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:49.472903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:49.481535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1269/2533] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:49.486366 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.493174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:49.497385 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34729d6-429c-49a6-85af-dfc2a3e0db1e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.504862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.505623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.506723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.506723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.507749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:52:49.508057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.509736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.525974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1265/2534] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:52:49.527732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.537492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ca9cb-2c55-4fc9-8c11-c6fc71fd3791 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.542483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.543160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.543441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.543704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.544511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.546498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.579956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1270/2535] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:49 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:49.584443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.597439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd80f4-5610-41d0-95be-27487d57b6d5 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.676922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.678327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.678803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.679200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.680131 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.682180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.707561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1266/2536] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:49 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:49.711964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.750860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301d219-500a-475e-aa30-5210a747a9d4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.774825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.775518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.775797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.776071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.777204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.779549 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.793196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1271/2537] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:49.796958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.808425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938ac3b-c789-43ed-be87-7c05f819c022 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.815289 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.816099 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.816446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.817377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.817619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.819969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.830899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1267/2538] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:49.835797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.853315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f699739-9beb-4182-95f9-99da0053c670 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:49.860575 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:49.861359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.861893 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.862351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] PATH_INFO: `/v3/projects/5ab7cf2f988e433997fa544dd7ca501a/users/721322efcaf2439e99809063264baf21/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.911571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab7cf2f988e433997fa544dd7ca501a, user_id=721322efcaf2439e99809063264baf21, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:49.920727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde555bd-c10b-4504-8967-20bf09541136 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:49.946138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1272/2539] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:49 2022] PUT /identity/v3/projects/5ab7cf2f988e433997fa544dd7ca501a/users/721322efcaf2439e99809063264baf21/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:49.955595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:49.956880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:49.957346 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:49.957814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:49.958970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:49.996624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] MFA Rules not processed for user `721322efcaf2439e99809063264baf21`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:49.997867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:50.028589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9c1a7-2202-45b4-af85-521445c6466a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.073116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:50.081900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1273/2540] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:50.082944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.085058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:50.093053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.094312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.095491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.095777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.099266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:50.146696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:50.163595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6af1ae-34bd-471a-8853-79e118be4a84 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.169414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.170379 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.170768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.171225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.174298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:50.175454 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.176924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.188650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1268/2541] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:50.189482 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.191237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.193380 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.199633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78904bb-9be6-42c0-a123-7398ec0ab7a9 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.205962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.206654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.206936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.207179 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.207899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.208112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1274/2542] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:50.210049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.242386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1269/2543] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:50 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:50.247595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.264573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0ffa9-776a-473a-babb-d2d5ee70e81d service placement] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.360880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.361602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.361889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.362209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.362928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.365066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.393285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1275/2544] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:50 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:50.397692 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.413477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27ab6-2003-418c-a4f8-6bbf6b5b3c45 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.420938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.421669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.422059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.422374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.423271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.425008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.462081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1270/2545] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:50.468334 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.487649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e264f1-af3e-4b14-8e02-8a321e4027c5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.504164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.506145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.506145 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.506690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] PATH_INFO: `/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7/users/247fafad6bbf4093b96b4c88193050b6/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.527258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d5c98f0a4d4d22aa14a8403cfff3e7, user_id=247fafad6bbf4093b96b4c88193050b6, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.529086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.550587 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1276/2546] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:50 2022] PUT /identity/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7/users/247fafad6bbf4093b96b4c88193050b6/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:50.551989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.563861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f6c31-97f0-4e11-9eae-24bfeacda29d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.665057 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.666295 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.666811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.667323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.668896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.672303 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7ae6-ce11-4c84-a061-5d56bbe4bdf0 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.692257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1271/2547] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:52:50.696224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.710828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e94ad5-70ea-4643-9743-96824ee53685 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:50.715985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:50.716886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.717094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.717374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] PATH_INFO: `/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7/users/247fafad6bbf4093b96b4c88193050b6/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.719648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d5c98f0a4d4d22aa14a8403cfff3e7, user_id=247fafad6bbf4093b96b4c88193050b6, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:50.722401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:50.734941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1277/2548] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:50 2022] PUT /identity/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7/users/247fafad6bbf4093b96b4c88193050b6/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:50.748178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ab48-48eb-4e4e-9969-9ffe821e15ae None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:50.748802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ab48-48eb-4e4e-9969-9ffe821e15ae None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:50.749091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ab48-48eb-4e4e-9969-9ffe821e15ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:50.794275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-bb94ab48-48eb-4e4e-9969-9ffe821e15ae None None] MFA Rules not processed for user `247fafad6bbf4093b96b4c88193050b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:50.795511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bb94ab48-48eb-4e4e-9969-9ffe821e15ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:50.908353 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1272/2549] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:50.918127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:50.920173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:51.008520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:51.040041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4bc42-e4ee-4975-b859-ca3dd09a061d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:51.054630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:51.055368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:51.055659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:51.055951 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:51.210767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:51.212215 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:51.224697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1278/2550] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:51.380893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:51.381216 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:51.381506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:51.402410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:51.406325 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:51.433149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:51.489172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1273/2551] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:52:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:51.506313 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:51.508375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:51.655029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe0580-63fd-44a7-a746-6c96a50de313 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:51.668081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:51.668919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:51.669291 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:51.670843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:51.682036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:51.683899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:51.696012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1279/2552] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:52:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 28 17:52:52.802753 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:52.804301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:52.819124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb0372-f801-4ab2-9375-6047f71ba2f3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:52.829833 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:52.830763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:52.831942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:52.832381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:52.845816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:52.847785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:52.873294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1274/2553] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:53.297669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:53.299255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:53.465869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d87bf-35b3-47bc-a099-a9aafbd31cde service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:53.490052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:53.491787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:53.492210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:53.492805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:53.494961 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:53.525928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:53.529686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:53.554214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1280/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:55.587835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:55.589276 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:55.682037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27475a-290b-4388-a80d-42cbb4a5edcb service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:55.687941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:55.688881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:55.689161 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:55.689436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] PATH_INFO: `/v3/users/b8215c04115a40c4b6f8eeebc53206d3` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:55.691064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8215c04115a40c4b6f8eeebc53206d3)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:55.693114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:55.756963 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8215c04115a40c4b6f8eeebc53206d3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:55.757827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8215c04115a40c4b6f8eeebc53206d3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:55.758496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8215c04115a40c4b6f8eeebc53206d3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:55.767293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8215c04115a40c4b6f8eeebc53206d3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:55.783534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-67d328c8-ddeb-4936-823c-256d90f5249e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8215c04115a40c4b6f8eeebc53206d3'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:55.812901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1275/2555] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:55 2022] DELETE /identity/v3/users/b8215c04115a40c4b6f8eeebc53206d3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:56.087856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.100263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ce18-8876-4b6f-a4d5-ee9bcfe4f2b9 service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.110235 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:56.176144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.177447 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.177746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.178074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] PATH_INFO: `/v3/projects/ddc196d83175439babbd1360eb771ed3` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.179356 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc196d83175439babbd1360eb771ed3)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.181469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.244582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc196d83175439babbd1360eb771ed3', 'request_id': 'req-a1f0a0e0-c22e-457b-8f76-732791575b50'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:56.251683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc196d83175439babbd1360eb771ed3', 'request_id': 'req-a1f0a0e0-c22e-457b-8f76-732791575b50'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:56.261040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc196d83175439babbd1360eb771ed3', 'request_id': 'req-a1f0a0e0-c22e-457b-8f76-732791575b50'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:56.281164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] The token cache is being invalidate because project ddc196d83175439babbd1360eb771ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:56.281518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:56.282241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1f0a0e0-c22e-457b-8f76-732791575b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:56.283796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1281/2556] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:56 2022] DELETE /identity/v3/projects/ddc196d83175439babbd1360eb771ed3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:56.289591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.289883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.290274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.311993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:56.313368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:56.349875 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:56.391423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1276/2557] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:56.402403 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.402746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.402977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.446772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:56.448032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:56.475939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1282/2558] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:56.481241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.507039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bff43-3b0f-43b3-9a89-4e6585daface None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.527538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.528240 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.528995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.528995 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.529723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:52:56.530076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.531990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.565960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1277/2559] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:52:56.569604 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.584818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4794ec-f586-40fc-ab03-a5dc25b693a0 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.609249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.611614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.612005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.612649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.613548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.619289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.690199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1283/2560] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:56 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:56.693780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.709582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d770-3668-420a-ab22-2fed1b9382cc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.834984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.835728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.836012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.836367 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.837010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.839377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.877669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1278/2561] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:56 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:56.878910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.896601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1f4d7-e3d6-4b8f-b425-d4df33253673 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.913136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.914296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.914651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.915168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.916371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.919455 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.936019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1284/2562] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:56.939771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.952446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25d5e-f798-417a-9329-c783187ce10a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:56.957332 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:56.958055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:56.958341 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:56.958619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:56.959383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:56.962293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49280696-8efa-4e67-a2e7-7a31ab01a1fb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:56.980352 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1279/2563] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:56.985741 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:56.996638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0043a-375c-46d8-b4e9-9b9de8f06805 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.001772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.002838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.003120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.003483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] PATH_INFO: `/v3/projects/1eeeb5ce60c74921a09ea14163e382ec/users/2a967293b7d2412fa3d7259ab0864c3f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.020653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eeeb5ce60c74921a09ea14163e382ec, user_id=2a967293b7d2412fa3d7259ab0864c3f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.023472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.041994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1285/2564] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:56 2022] PUT /identity/v3/projects/1eeeb5ce60c74921a09ea14163e382ec/users/2a967293b7d2412fa3d7259ab0864c3f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:57.053622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.054327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.054905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.090679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] MFA Rules not processed for user `2a967293b7d2412fa3d7259ab0864c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:57.092511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:57.164362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.167267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:57.193287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1280/2565] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:57.197870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.229478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:57.258166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8d25e-e801-4364-8c58-781965450c5f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.264454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.265885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.265885 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.266188 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] PATH_INFO: `/v3/users/721322efcaf2439e99809063264baf21` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.267515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] RBAC: Authorizing `identity:delete_user(user_id=721322efcaf2439e99809063264baf21)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.269611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.271837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:57.333605 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbec58-bf25-46a6-af33-e1a591ef9fff None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.341752 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.343135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.343503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.344239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.345786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.355478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.368943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721322efcaf2439e99809063264baf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:57.385566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721322efcaf2439e99809063264baf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:57.387507 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721322efcaf2439e99809063264baf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:57.403533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721322efcaf2439e99809063264baf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:57.425991 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1281/2566] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:57 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:52:57.430301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.439742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-03f92155-e8d9-4cfb-a414-be8fe8f4893e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721322efcaf2439e99809063264baf21'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:57.456132 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1286/2567] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:57 2022] DELETE /identity/v3/users/721322efcaf2439e99809063264baf21 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:57.459714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.460335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.462764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.496333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:57.497641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:57.601149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42695eb-b93b-49ff-a3eb-f2a9e2e7899e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.614756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1287/2568] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:57.621591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.623660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:57.707700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.708402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.708571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6b52c-0967-463c-91f0-2adbc0e9b1d1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.708704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.708935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.709701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.713727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.715219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.716135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.716595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.716958 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.732227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.735265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.747426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:57.754765 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1282/2569] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:57 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:57.765769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.768030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:57.777275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1288/2570] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:57.783316 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa8fdb-db9f-41db-b9b5-262079627cb4 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.788637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.789476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.789863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.790284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.791132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.793387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.813327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1283/2571] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:57.814568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.825227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563be25-2385-4f83-92e1-6bee6ae3d1ae service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:57.836746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:57.837925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:57.838332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:57.839239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] PATH_INFO: `/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b/users/e2bed3e4fba64956913698d633eafa33/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:57.882255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5abe1f5ac6b4ff094aa50c77daea75b, user_id=e2bed3e4fba64956913698d633eafa33, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:57.885300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:57.914013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1289/2572] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:57 2022] PUT /identity/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b/users/e2bed3e4fba64956913698d633eafa33/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:57.915497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:57.928498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf6aee-36cb-4e37-ae57-025a6e0a7655 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:58.031685 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:58.076270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:58.076270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.076270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.076270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.076897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:58.076897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:58.110576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1284/2573] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:52:58.111866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:58.130284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20aa1a-c1a3-40dc-b7c9-fa7f23faa9fe admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:58.146168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:58.147218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.147522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.147801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] PATH_INFO: `/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b/users/e2bed3e4fba64956913698d633eafa33/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.150385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5abe1f5ac6b4ff094aa50c77daea75b, user_id=e2bed3e4fba64956913698d633eafa33, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:58.155271 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2941d1d-6b3a-42f9-b991-0a620c760601 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:58.190103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:58.192512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.194094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1290/2574] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:52:58 2022] PUT /identity/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b/users/e2bed3e4fba64956913698d633eafa33/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:58.198632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c291-380c-4f24-a617-30a269847544 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.198936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c291-380c-4f24-a617-30a269847544 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.199489 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c291-380c-4f24-a617-30a269847544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.228717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1622e6-6e16-4df6-8bd6-67460fd85311 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:58.256866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-8c02c291-380c-4f24-a617-30a269847544 None None] MFA Rules not processed for user `e2bed3e4fba64956913698d633eafa33`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:58.258273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8c02c291-380c-4f24-a617-30a269847544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.330828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:58.332018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.332490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.332957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] PATH_INFO: `/v3/projects/5ab7cf2f988e433997fa544dd7ca501a` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.334594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab7cf2f988e433997fa544dd7ca501a)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:58.336909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:58.371079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1291/2575] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:52:58.385252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c291-380c-4f24-a617-30a269847544 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:58.387363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-8c02c291-380c-4f24-a617-30a269847544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.420388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab7cf2f988e433997fa544dd7ca501a', 'request_id': 'req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.435003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab7cf2f988e433997fa544dd7ca501a', 'request_id': 'req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.444397 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab7cf2f988e433997fa544dd7ca501a', 'request_id': 'req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.461773 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] The token cache is being invalidate because project 5ab7cf2f988e433997fa544dd7ca501a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:58.462376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.465805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.472062 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1285/2576] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:58 2022] DELETE /identity/v3/projects/5ab7cf2f988e433997fa544dd7ca501a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:52:58.473362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:58.476342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.496490 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c291-380c-4f24-a617-30a269847544 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:58.586438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfed11b-7bc9-408e-9a11-3e62d293bd8a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:58.593465 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:58.594121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:58.594900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.595266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:58.595718 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.596148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] PATH_INFO: `/v3/users/247fafad6bbf4093b96b4c88193050b6` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.596336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:58.596726 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:58.598149 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247fafad6bbf4093b96b4c88193050b6)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:58.599483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.600819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:58.614538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:58.632839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:58.691894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247fafad6bbf4093b96b4c88193050b6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.694312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247fafad6bbf4093b96b4c88193050b6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.695716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247fafad6bbf4093b96b4c88193050b6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.708923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:58.711311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247fafad6bbf4093b96b4c88193050b6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.712400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:58.725241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247fafad6bbf4093b96b4c88193050b6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:58.733498 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1292/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:52:58.777190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1286/2578] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:52:58 2022] DELETE /identity/v3/users/247fafad6bbf4093b96b4c88193050b6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:58.911739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:58.921065 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:58.946622 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb7746-199b-426e-9b7c-cd7e3c5edc01 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:59.055391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:59.056537 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.057041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.057525 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.061543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:59.225791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:59.227314 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd84d1-0d3c-4b89-bad2-808e5942e7ea service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:59.247492 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1293/2579] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:52:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:52:59.270028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:59.271542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:59.420079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3f61-2255-4fd6-8b8c-0beaba207387 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:59.425919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:59.426893 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.427175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.427448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] PATH_INFO: `/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.428672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d5c98f0a4d4d22aa14a8403cfff3e7)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:59.430659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:59.495689 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d5c98f0a4d4d22aa14a8403cfff3e7', 'request_id': 'req-a7b35deb-13a5-4581-b9da-558388efc0bb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:59.504979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d5c98f0a4d4d22aa14a8403cfff3e7', 'request_id': 'req-a7b35deb-13a5-4581-b9da-558388efc0bb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:59.516873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d5c98f0a4d4d22aa14a8403cfff3e7', 'request_id': 'req-a7b35deb-13a5-4581-b9da-558388efc0bb'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:59.535331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] The token cache is being invalidate because project 14d5c98f0a4d4d22aa14a8403cfff3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:52:59.535696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:59.536377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-a7b35deb-13a5-4581-b9da-558388efc0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:52:59.541697 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1287/2580] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:52:59 2022] DELETE /identity/v3/projects/14d5c98f0a4d4d22aa14a8403cfff3e7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:52:59.543832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.544195 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.544476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.579613 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:59.582509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:59.702845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1294/2581] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:52:59.727473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.728090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.728174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.751684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:52:59.752965 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:52:59.774172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1288/2582] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:52:59.776966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:59.788263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fa5fa-da52-446d-aa89-d7a01e789619 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:59.797983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:59.797983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.797983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.797983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.798732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:52:59.799044 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:59.801263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:59.808511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:59.831321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1295/2583] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:52:59.835873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:59.847034 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e4dfb-caf9-4319-b758-b4077fc89d12 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:59.852071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:59.852741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.853027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.853302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.854133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:59.856048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:52:59.864894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:52:59.884420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1289/2584] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:52:59 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:52:59.888316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:52:59.909232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c563d7e-e01e-4bb1-b839-cae36ca91034 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:52:59.984055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:52:59.985560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:52:59.985845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:52:59.986152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:52:59.986849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:52:59.988764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.018576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1296/2585] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:52:59 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:00.022986 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.035767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83dff-0363-43b4-9401-ba8d84cf0549 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.043473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.044256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.044604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.044948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.045749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.047672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.065708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1290/2586] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:00.067212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.080276 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bbd2e-958e-461e-b5f9-5796137dc579 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.085335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.086219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.086491 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.086770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.087534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.090030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56283551-7b4c-44d4-81d8-60360be46816 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.106036 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1297/2587] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:00.107168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.118496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9c59-7c0a-498c-b5ac-bd2a2622c03a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.124777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.125962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.126174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.126534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] PATH_INFO: `/v3/projects/4a9fba5cff614234a0c49d2fa84cc547/users/04637986e4ed48f99e50ded8cd0d469d/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.145983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9fba5cff614234a0c49d2fa84cc547, user_id=04637986e4ed48f99e50ded8cd0d469d, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.148767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.168083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1291/2588] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:00 2022] PUT /identity/v3/projects/4a9fba5cff614234a0c49d2fa84cc547/users/04637986e4ed48f99e50ded8cd0d469d/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:00.179483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.179771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.180048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.217270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] MFA Rules not processed for user `04637986e4ed48f99e50ded8cd0d469d`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:00.218592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:00.306091 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1298/2589] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:00.313757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.394816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225b7a-6a26-4fd9-a20d-842d9ea1e331 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.405523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.406335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.406672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.406975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.408040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.409589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.458157 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1292/2590] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:00 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:00.460144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.476769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f744-0664-444c-8166-84d9ff4a351f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.575842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.577068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.577706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.578175 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.579520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.582217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.596045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:00.619146 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1299/2591] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:00 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:00.619764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.634253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa0a9-2a6a-41fa-82a4-469b6c4b8403 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.645647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.646908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.647257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.647764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.650524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.650524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.666511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1293/2592] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:00.671200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.685203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a996-5ce8-4228-99d7-3b5c9fed7f39 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.691462 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.692535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.692815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.693144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] PATH_INFO: `/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7/users/ad17b84df65b4a4bbe1d23a4d8e15643/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.727057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8534441c1f2f4bf39fec1f616f72ffb7, user_id=ad17b84df65b4a4bbe1d23a4d8e15643, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.730331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.748336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1300/2593] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:00 2022] PUT /identity/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7/users/ad17b84df65b4a4bbe1d23a4d8e15643/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:00.752394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.773106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd5f4-3f74-4515-88e6-e833f6fbf664 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.882596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.883288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.883573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.883849 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.885124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.886803 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c240c-7afc-4706-9f78-b3f383b82181 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.904809 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1294/2594] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:00.906744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:00.925037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542e4e0-a7d6-4b83-bbfd-0cbb417f9146 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:00.934484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:00.937995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.937995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.937995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] PATH_INFO: `/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7/users/ad17b84df65b4a4bbe1d23a4d8e15643/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:00.940385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8534441c1f2f4bf39fec1f616f72ffb7, user_id=ad17b84df65b4a4bbe1d23a4d8e15643, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:00.959138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:00.975860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1301/2595] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:00 2022] PUT /identity/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7/users/ad17b84df65b4a4bbe1d23a4d8e15643/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:00.987166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:00.987447 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:00.989387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:01.022386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] MFA Rules not processed for user `ad17b84df65b4a4bbe1d23a4d8e15643`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:01.023993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:01.045119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:01.149165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1295/2596] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:01.169261 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:01.172957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:01.275438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198752c-d562-48d1-b911-36b3fecb0c0a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:01.280712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:01.281505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:01.281784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:01.282144 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:01.298494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:01.299964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:01.314487 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1302/2597] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:01.772666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:01.787460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e5bf8-bcf6-4fb1-af43-745a33a9af58 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:01.794135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad17b84df65b4a4bbe1d23a4d8e15643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8534441c1f2f4bf39fec1f616f72ffb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:01.795654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:01.796029 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:01.796375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:01.797277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:01.797804 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:01.802460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:01.823336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:01.831143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1296/2598] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:01.851344 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7460d8-03fd-4bc9-98be-f63c60055cee service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:01.857042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad17b84df65b4a4bbe1d23a4d8e15643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8534441c1f2f4bf39fec1f616f72ffb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:01.858240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:01.858240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:01.858599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:01.859465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:01.861706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:01.934059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:01.942596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1303/2599] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:01 2022] POST /identity/v3/projects => generated 354 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:01.946596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80cb43-c1e5-4951-9598-1c479e506271 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.027126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad17b84df65b4a4bbe1d23a4d8e15643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8534441c1f2f4bf39fec1f616f72ffb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.027955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.028519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.028871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.029808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:02.030156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.031881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.052200 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1297/2600] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:02.093656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:02.108982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c029a-e6e9-432a-a47d-64b11f1f586c tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.115050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad17b84df65b4a4bbe1d23a4d8e15643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8534441c1f2f4bf39fec1f616f72ffb7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.116133 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.116805 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.117219 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] PATH_INFO: `/v3/projects/d71c6a4c30e64cda95e0157e2464c11c` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.118594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d71c6a4c30e64cda95e0157e2464c11c)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.120710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.165635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:02.167490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.202207 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71c6a4c30e64cda95e0157e2464c11c', 'request_id': 'req-c943f8e8-890c-42a3-940b-f6fac494f8f0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.208616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71c6a4c30e64cda95e0157e2464c11c', 'request_id': 'req-c943f8e8-890c-42a3-940b-f6fac494f8f0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.216244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71c6a4c30e64cda95e0157e2464c11c', 'request_id': 'req-c943f8e8-890c-42a3-940b-f6fac494f8f0'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.238628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] The token cache is being invalidate because project d71c6a4c30e64cda95e0157e2464c11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:02.238990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.239648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.241444 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1304/2601] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:02 2022] DELETE /identity/v3/projects/d71c6a4c30e64cda95e0157e2464c11c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:02.275103 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b13f8-5f4d-455b-b4e4-bdb9f5b7a92f tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.336244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:02.392738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.393829 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.394165 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.394672 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] PATH_INFO: `/v3/users/2a967293b7d2412fa3d7259ab0864c3f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.395968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a967293b7d2412fa3d7259ab0864c3f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.398406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.482515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a967293b7d2412fa3d7259ab0864c3f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.483281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a967293b7d2412fa3d7259ab0864c3f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.483838 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a967293b7d2412fa3d7259ab0864c3f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.500308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a967293b7d2412fa3d7259ab0864c3f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.518546 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-15082f45-7f21-4e19-b0cd-d391c08a0a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a967293b7d2412fa3d7259ab0864c3f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.520230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:02.522191 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.537764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943f8e8-890c-42a3-940b-f6fac494f8f0 tempest-VolumeQuotaClassesTest-333913704 tempest-VolumeQuotaClassesTest-333913704-project-admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.545240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.546288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.548171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.548560 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] PATH_INFO: `/v3/users/04637986e4ed48f99e50ded8cd0d469d` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.550143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04637986e4ed48f99e50ded8cd0d469d)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.550317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1298/2602] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:02 2022] DELETE /identity/v3/users/2a967293b7d2412fa3d7259ab0864c3f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:02.553990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.554521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.554738 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.554865 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.579360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:02.581153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:02.582632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.656168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04637986e4ed48f99e50ded8cd0d469d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.669802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04637986e4ed48f99e50ded8cd0d469d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.671351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04637986e4ed48f99e50ded8cd0d469d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.674167 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1299/2603] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:02.688124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:02.690544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.691989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04637986e4ed48f99e50ded8cd0d469d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.714632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fa79b9e1-d3cc-4a4c-9a98-81de24453f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04637986e4ed48f99e50ded8cd0d469d'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:02.728723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1305/2604] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:02 2022] DELETE /identity/v3/users/04637986e4ed48f99e50ded8cd0d469d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:02.735212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.735212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.735212 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.774608 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:02.776359 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.799334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523adcb1-2478-4c09-a88f-8d569784249f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.814751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:02.864614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1306/2605] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:02.873836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:02.875761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.879958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.880652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.880940 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.881186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.883365 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:02.889671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f4bab-f8d7-486d-8af0-ae91c3950934 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:02.893875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:02.894671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:02.894963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:02.895258 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:02.897555 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.899182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.907096 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:02.908606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:02.912978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1300/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:02.939973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1307/2607] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:03.478790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:03.480830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:03.486698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:03.489176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:03.508408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7589d3-ba9c-4d10-9a19-ebf00fb95b55 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:03.515218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:03.517652 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:03.518217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:03.518774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] PATH_INFO: `/v3/projects/1eeeb5ce60c74921a09ea14163e382ec` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:03.525237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ef91d-2d09-45ab-ae5f-deac1f3042a0 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:03.535304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eeeb5ce60c74921a09ea14163e382ec)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:03.539341 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:03.541071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:03.541376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:03.541639 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] PATH_INFO: `/v3/projects/4a9fba5cff614234a0c49d2fa84cc547` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:03.541897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:03.543067 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9fba5cff614234a0c49d2fa84cc547)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:03.545156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:03.618757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9fba5cff614234a0c49d2fa84cc547', 'request_id': 'req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.630845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9fba5cff614234a0c49d2fa84cc547', 'request_id': 'req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.634302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eeeb5ce60c74921a09ea14163e382ec', 'request_id': 'req-11a4555c-7d7b-4643-ae4e-523a5959b837'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.638740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9fba5cff614234a0c49d2fa84cc547', 'request_id': 'req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.650405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eeeb5ce60c74921a09ea14163e382ec', 'request_id': 'req-11a4555c-7d7b-4643-ae4e-523a5959b837'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.663963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] The token cache is being invalidate because project 4a9fba5cff614234a0c49d2fa84cc547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:03.666008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.666637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.673411 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1308/2608] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:03 2022] DELETE /identity/v3/projects/4a9fba5cff614234a0c49d2fa84cc547 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:03.674602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eeeb5ce60c74921a09ea14163e382ec', 'request_id': 'req-11a4555c-7d7b-4643-ae4e-523a5959b837'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.674994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:03.677205 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:03.683441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:03.700347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] The token cache is being invalidate because project 1eeeb5ce60c74921a09ea14163e382ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:03.702260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.703330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.705933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1301/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:03 2022] DELETE /identity/v3/projects/1eeeb5ce60c74921a09ea14163e382ec => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:03.710575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:03.712333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:03.787130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd0b68-4a5c-4498-8ad4-21193c5b0387 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:03.809502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4555c-7d7b-4643-ae4e-523a5959b837 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:03.816079 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:03.817799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:03.818215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:03.819196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] PATH_INFO: `/v3/users/e2bed3e4fba64956913698d633eafa33` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:03.820820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bed3e4fba64956913698d633eafa33)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:03.823703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:03.868797 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:03.869892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:03.870336 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:03.870534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] PATH_INFO: `/v3/users/ad17b84df65b4a4bbe1d23a4d8e15643` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:03.871826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad17b84df65b4a4bbe1d23a4d8e15643)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:03.874919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:03.896051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:03.903475 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bed3e4fba64956913698d633eafa33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.904562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bed3e4fba64956913698d633eafa33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.905321 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bed3e4fba64956913698d633eafa33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.917855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bed3e4fba64956913698d633eafa33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.939974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bed3e4fba64956913698d633eafa33'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.972214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad17b84df65b4a4bbe1d23a4d8e15643'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.975725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1302/2610] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:03 2022] DELETE /identity/v3/users/e2bed3e4fba64956913698d633eafa33 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:03.981076 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad17b84df65b4a4bbe1d23a4d8e15643'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.981795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad17b84df65b4a4bbe1d23a4d8e15643'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:03.992812 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad17b84df65b4a4bbe1d23a4d8e15643'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.009393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad17b84df65b4a4bbe1d23a4d8e15643'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.019392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1309/2611] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:03 2022] DELETE /identity/v3/users/ad17b84df65b4a4bbe1d23a4d8e15643 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:04.366127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.367712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.457177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.459068 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.482754 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa125614-a77a-4c83-a30c-a9f6a364638b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.509762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:04.557987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f7a3-993e-4857-9079-b8c9034cc70f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.562970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.563246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.563848 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.564124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.564317 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.564439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] PATH_INFO: `/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.564834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.565326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] PATH_INFO: `/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.565846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8534441c1f2f4bf39fec1f616f72ffb7)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.566998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5abe1f5ac6b4ff094aa50c77daea75b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.568241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.569576 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.637145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8534441c1f2f4bf39fec1f616f72ffb7', 'request_id': 'req-c17816a2-2e67-4104-b410-ff21a330f669'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.645214 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8534441c1f2f4bf39fec1f616f72ffb7', 'request_id': 'req-c17816a2-2e67-4104-b410-ff21a330f669'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.652027 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5abe1f5ac6b4ff094aa50c77daea75b', 'request_id': 'req-bc7c5126-1773-4d11-af93-94563f827fb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.664452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8534441c1f2f4bf39fec1f616f72ffb7', 'request_id': 'req-c17816a2-2e67-4104-b410-ff21a330f669'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.666729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5abe1f5ac6b4ff094aa50c77daea75b', 'request_id': 'req-bc7c5126-1773-4d11-af93-94563f827fb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.669531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:04.676748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5abe1f5ac6b4ff094aa50c77daea75b', 'request_id': 'req-bc7c5126-1773-4d11-af93-94563f827fb2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.686535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] The token cache is being invalidate because project 8534441c1f2f4bf39fec1f616f72ffb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:04.686852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.687545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c17816a2-2e67-4104-b410-ff21a330f669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.690177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1303/2612] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:04 2022] DELETE /identity/v3/projects/8534441c1f2f4bf39fec1f616f72ffb7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:04.695201 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] The token cache is being invalidate because project a5abe1f5ac6b4ff094aa50c77daea75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:04.695538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.696161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-bc7c5126-1773-4d11-af93-94563f827fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:04.696467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d0aa-5551-4d84-af36-f84156a68209 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.696900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d0aa-5551-4d84-af36-f84156a68209 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.697279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588d0aa-5551-4d84-af36-f84156a68209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.697994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1310/2613] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:04 2022] DELETE /identity/v3/projects/a5abe1f5ac6b4ff094aa50c77daea75b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:04.702991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5611-edfd-48cd-83d7-884a4408cebf None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.703328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5611-edfd-48cd-83d7-884a4408cebf None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.703572 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a5611-edfd-48cd-83d7-884a4408cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.722260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b588d0aa-5551-4d84-af36-f84156a68209 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:04.723594 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c37a5611-edfd-48cd-83d7-884a4408cebf None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:04.723728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b588d0aa-5551-4d84-af36-f84156a68209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.724927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c37a5611-edfd-48cd-83d7-884a4408cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.807376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1304/2614] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:04.813112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1311/2615] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:04.815820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.816395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.816395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.821249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.821618 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.822092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.837244 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:04.839431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.842985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:04.844860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:04.857375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1305/2616] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:04.857595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1312/2617] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:04.857962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.858998 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.869976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c000-5a2d-4811-83a2-4daace53583f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.874194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278581-4908-488f-8d1a-fa2006392506 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.875115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.875904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.876283 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.876657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.877527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:04.878070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.880590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.883088 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.884260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.884717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.885201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.886646 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:04.887358 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.890740 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.899959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1313/2618] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 28 17:53:04.906134 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.916852 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1306/2619] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:04.920391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60179ac-0a85-4c0e-bb5c-7e14cd966012 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.921170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.926834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.927732 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.928116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.929351 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.929671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.932086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.935981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74073432-ae88-4f02-9eb0-f01ed68351f8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:04.942381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:04.943241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:04.943636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:04.943973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:04.944914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:04.947630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:04.973178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1314/2620] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:04.978393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:04.987253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1307/2621] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:53:04.988625 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.008651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:05.070648 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34359669-89be-4eb1-baa7-8eaedd07d5d9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.075917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fa5b3-8162-4eaa-b31d-56419f9f6628 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.076515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.077524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.078079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.078421 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.079299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.081740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.083808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.084567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.084853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.085119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.085827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.088192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.117980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1315/2622] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:05.118279 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1308/2623] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:04 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:05.121843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.122153 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.135663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cbbba-bed1-4ebb-9b07-c6d1707985b1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.135906 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6b16-32f8-461d-b9b5-18c77278425f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.141709 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.141972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.143064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.143179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.143361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.143638 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.143735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.144131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.144388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.145010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.146392 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.147566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.159459 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1309/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:05.166497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1316/2625] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:53:05.167578 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.168316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.180550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6a52-b516-4230-a26a-36cffe0ade21 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.185279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a8d-2789-4b22-9096-7b2827f4f73f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.192102 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.193173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.193377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.193832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.194308 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.194489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.194657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.194925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.195799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.196484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.197868 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.198183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.212391 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1310/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:53:05.218474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.219671 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1317/2627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:53:05.224933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.232338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6fd0a-55f4-4e09-9b14-175a40c861c1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.241144 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.242168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be8196-c223-4f67-a7b3-a52dce6224ad admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.242314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.242538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.242778 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] PATH_INFO: `/v3/projects/60582d84e5ba4556bb0b7e4ed978ba2e/users/372d78ad02e249389720b22adba7af68/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.250242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.251110 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.251390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.251657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] PATH_INFO: `/v3/projects/8344ce1505a44c21b6749d8a79932f7f/users/11b3499b265f480483b9b36cdb29ae9b/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.269190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60582d84e5ba4556bb0b7e4ed978ba2e, user_id=372d78ad02e249389720b22adba7af68, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.274521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8344ce1505a44c21b6749d8a79932f7f, user_id=11b3499b265f480483b9b36cdb29ae9b, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.275617 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0759d-06c6-4caf-a978-5ef0aaec8b48 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.278304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d021d55-49d1-4909-9ee3-6816f60d734e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.293987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:05.310009 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1318/2628] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:05 2022] PUT /identity/v3/projects/8344ce1505a44c21b6749d8a79932f7f/users/11b3499b265f480483b9b36cdb29ae9b/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:05.310438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1311/2629] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:05 2022] PUT /identity/v3/projects/60582d84e5ba4556bb0b7e4ed978ba2e/users/372d78ad02e249389720b22adba7af68/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:05.321856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.322746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.324652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.326701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.327486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.327486 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.367298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] MFA Rules not processed for user `372d78ad02e249389720b22adba7af68`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:05.368756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:05.370436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] MFA Rules not processed for user `11b3499b265f480483b9b36cdb29ae9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:05.371653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:05.459615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1312/2630] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:05.460714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.485014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1319/2631] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:05.487121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.557035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:05.572035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef51d1-06d3-40e6-b551-2fefba2ca58b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.579221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5cb7-5ea8-4f20-b9a0-2a14f09b563b None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.580371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.581164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.581542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.581932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.582749 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.583908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.584917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.593182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.593603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.594055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.595262 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.597767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.624333 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1320/2632] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:05.630004 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.633120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1313/2633] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:05.637097 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.716021 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdb5a0-576c-443d-ad44-9ee34385e789 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.721631 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.722567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.722901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.723177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.723896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.727239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.734795 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196ab7-b145-441a-84ef-365d955bd29d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.742928 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.744232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.744362 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.744790 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.746148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.751160 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.783048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1314/2634] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:53:05.783155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1321/2635] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:05 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:05.786794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.788520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.794410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:05.800828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bac31-856b-45ff-a59f-b213171159de admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.807656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f3c57-1822-4ea8-9a19-4818be09b07b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.807890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.808478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.809335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.809741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.810553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.812544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.823659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.824358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.824652 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.824949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.825117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1315/2636] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:05.826097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.828179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.829016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.840538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1322/2637] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:05.841011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7acf40-ba3e-4144-b2ae-d58b977061c3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.845473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.846446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.847398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.847751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.848096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] PATH_INFO: `/v3/projects/43c18e463a7f4665b8f7b41de8b3009a/users/3a94f6f2fc9848538663d3c18cb9d300/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.865621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69019e07-421a-4750-bfa7-ebfb128b19a8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:05.867313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c18e463a7f4665b8f7b41de8b3009a, user_id=3a94f6f2fc9848538663d3c18cb9d300, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.870056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.874595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:05.876377 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:05.877540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:05.877540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] PATH_INFO: `/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f/users/4b337074cbcb4460acb3087cf14f84e0/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:05.890196 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1316/2638] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:05 2022] PUT /identity/v3/projects/43c18e463a7f4665b8f7b41de8b3009a/users/3a94f6f2fc9848538663d3c18cb9d300/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:05.891797 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.907903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49e45aa74d4ac6a964c8d6e511d50f, user_id=4b337074cbcb4460acb3087cf14f84e0, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:05.912515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:05.938565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1323/2639] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:05 2022] PUT /identity/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f/users/4b337074cbcb4460acb3087cf14f84e0/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:05.943234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:05.970253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252989-488d-444c-83d7-b25ff9a42b2f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.023388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb63c35-8ddb-4e64-be53-31a0ac88a269 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.029401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.030155 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.030441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.030743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.031554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.033237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.048803 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1324/2640] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:06.049994 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.055696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.056961 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.057543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.058084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.059553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.061000 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38f76c-6b6e-4433-a58b-1713cd76ce0a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.061530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.066010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.066937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.067220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.067494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] PATH_INFO: `/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f/users/4b337074cbcb4460acb3087cf14f84e0/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.072828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea49e45aa74d4ac6a964c8d6e511d50f, user_id=4b337074cbcb4460acb3087cf14f84e0, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.074209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1317/2641] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:06.076417 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c45c-65bd-45bd-8b5b-32ac7447fbeb admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.080134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.090657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5d67-75f3-4691-b0c7-b3aa706eb51e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.094506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1325/2642] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:06 2022] PUT /identity/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f/users/4b337074cbcb4460acb3087cf14f84e0/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:06.111111 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.111389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.111657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.137807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:06.141924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] MFA Rules not processed for user `4b337074cbcb4460acb3087cf14f84e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:06.144524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:06.156801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.157731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.158127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.158344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] PATH_INFO: `/v3/projects/43c18e463a7f4665b8f7b41de8b3009a/users/3a94f6f2fc9848538663d3c18cb9d300/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.160494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c18e463a7f4665b8f7b41de8b3009a, user_id=3a94f6f2fc9848538663d3c18cb9d300, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.163265 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09630a-bbf3-438f-87dd-80af3973da06 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.175320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1318/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:06 2022] PUT /identity/v3/projects/43c18e463a7f4665b8f7b41de8b3009a/users/3a94f6f2fc9848538663d3c18cb9d300/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:06.187751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.188016 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.189004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.197314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:06.223343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] MFA Rules not processed for user `3a94f6f2fc9848538663d3c18cb9d300`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:06.224579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:06.251138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1326/2644] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:06.263472 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.264972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:06.306204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1319/2645] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:06.318948 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.320468 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:06.334084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d3f4f-0a26-43f3-a501-2e88d9074beb None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.382420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd64fd-2638-4dd5-81ae-7d174638f962 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.386726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.387387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.387667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.387943 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.390163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.390835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.391118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.391397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.398584 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.401636 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.415018 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1320/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:06.467426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.469708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.482077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1327/2647] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:06.577569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.596784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.602921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:06.607756 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5abd16-a9b6-4746-954b-75f22d9dabd8 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.612459 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.613131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.613407 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.613689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.651377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15d7a9-3cc5-4f42-b82d-848f8a6626fc service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:06.656462 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:06.657374 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.657656 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.657932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] PATH_INFO: `/v3/users/11b3499b265f480483b9b36cdb29ae9b` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.659548 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b3499b265f480483b9b36cdb29ae9b)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.661713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.681542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:06.683043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792256a-207c-4b07-86d5-c67464e262e4 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:06.697290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1328/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:06.709820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:06.722968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b3499b265f480483b9b36cdb29ae9b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:06.723699 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b3499b265f480483b9b36cdb29ae9b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:06.724424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b3499b265f480483b9b36cdb29ae9b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:06.732398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b3499b265f480483b9b36cdb29ae9b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:06.740845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b3499b265f480483b9b36cdb29ae9b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:06.761996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1321/2649] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:06 2022] DELETE /identity/v3/users/11b3499b265f480483b9b36cdb29ae9b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:06.770140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:06.770431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:06.770703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:06.792054 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:06.793343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:06.890800 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1329/2650] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:06.902246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:06.903841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:07.008272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a58f2b-853d-45c1-857d-eb5540eb4219 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:07.015416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:07.016222 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:07.016512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:07.016794 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:07.031382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:07.032915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:07.044793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1322/2651] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:07.380798 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:07.382647 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:07.400045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a4805-b83a-4005-a88e-0a4f140fe715 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:07.406307 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:07.408698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:07.409232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:07.409702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] PATH_INFO: `/v3/projects/8344ce1505a44c21b6749d8a79932f7f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:07.411806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8344ce1505a44c21b6749d8a79932f7f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:07.414100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:07.470248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8344ce1505a44c21b6749d8a79932f7f', 'request_id': 'req-15c88829-9e48-4629-9dd9-84f9625c66ee'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.477186 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8344ce1505a44c21b6749d8a79932f7f', 'request_id': 'req-15c88829-9e48-4629-9dd9-84f9625c66ee'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.484360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8344ce1505a44c21b6749d8a79932f7f', 'request_id': 'req-15c88829-9e48-4629-9dd9-84f9625c66ee'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.504152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] The token cache is being invalidate because project 8344ce1505a44c21b6749d8a79932f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:07.504932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.505748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.508457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1330/2652] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:07 2022] DELETE /identity/v3/projects/8344ce1505a44c21b6749d8a79932f7f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:07.514801 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:07.530457 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca4025-1536-489d-ac0e-61f5f4a12ee6 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:07.596703 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:07.597615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:07.597896 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:07.598210 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] PATH_INFO: `/v3/users/3a94f6f2fc9848538663d3c18cb9d300` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:07.599480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a94f6f2fc9848538663d3c18cb9d300)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:07.610910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:07.678257 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a94f6f2fc9848538663d3c18cb9d300'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.678926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a94f6f2fc9848538663d3c18cb9d300'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.679535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a94f6f2fc9848538663d3c18cb9d300'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.687497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a94f6f2fc9848538663d3c18cb9d300'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.689498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:07.697911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-6c248b33-a6c0-4f13-a1fe-ee7ed759533d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a94f6f2fc9848538663d3c18cb9d300'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:07.717802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1323/2653] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:07 2022] DELETE /identity/v3/users/3a94f6f2fc9848538663d3c18cb9d300 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:08.040676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.042352 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:08.077213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88829-9e48-4629-9dd9-84f9625c66ee admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.122069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:08.168927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.169874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.170122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.170401 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] PATH_INFO: `/v3/projects/43c18e463a7f4665b8f7b41de8b3009a` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.171870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c18e463a7f4665b8f7b41de8b3009a)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.174315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.260226 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c18e463a7f4665b8f7b41de8b3009a', 'request_id': 'req-267c29aa-2f81-4586-9d36-a71caa360ac2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:08.277661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c18e463a7f4665b8f7b41de8b3009a', 'request_id': 'req-267c29aa-2f81-4586-9d36-a71caa360ac2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:08.295270 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c18e463a7f4665b8f7b41de8b3009a', 'request_id': 'req-267c29aa-2f81-4586-9d36-a71caa360ac2'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:08.319066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] The token cache is being invalidate because project 43c18e463a7f4665b8f7b41de8b3009a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:08.319668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:08.321206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-267c29aa-2f81-4586-9d36-a71caa360ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:08.323600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1331/2654] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:08 2022] DELETE /identity/v3/projects/43c18e463a7f4665b8f7b41de8b3009a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:08.330003 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.331206 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.331649 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.358188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:08.360379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:08.437789 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1324/2655] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:08.449077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.449391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.449668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.475919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:08.477488 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:08.495055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1332/2656] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:08.500329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.516506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922483b-83c8-4c16-b31a-7b763b6a98d8 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.522729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.523776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.524234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.524677 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.525768 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:08.526946 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.528915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.546681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1325/2657] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:08.551426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.561702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67213e8-23a2-4138-b0f4-6181242b4ea8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.567989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.568907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.569242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.569551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.570478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.574042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.616853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1333/2658] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:08 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:53:08.618762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.634795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077c882-184a-4aca-87f7-e0905b1ae95c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.759423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.761274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.762151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.763184 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.766181 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.770863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.809476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1326/2659] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:08 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:08.814984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.831112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35036ca0-6ab0-41d1-8c79-705a708c6ac4 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.837023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.838063 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.838418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.838758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.839578 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.841412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.854875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1334/2660] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:08.859855 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.878979 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a72-6bb8-41a7-be8d-3f42a4c7ff63 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.887031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.888319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.888709 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.889002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.890489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.893396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1e6b-0912-42bf-8d03-4364c69aad89 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.911687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1327/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:08.916982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:08.931465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33476668-c9f2-404d-af21-14d375dc1d5c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:08.936600 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:08.937887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.938213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.938506 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] PATH_INFO: `/v3/projects/339057e36e6b40b9ba194b0e463f6f58/users/436c5a5e7af9414b9017c603ae5a35d8/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:08.957078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339057e36e6b40b9ba194b0e463f6f58, user_id=436c5a5e7af9414b9017c603ae5a35d8, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:08.959873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:08.975627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1335/2662] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:08 2022] PUT /identity/v3/projects/339057e36e6b40b9ba194b0e463f6f58/users/436c5a5e7af9414b9017c603ae5a35d8/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:08.981285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c26c-774f-4622-8683-e5c099f81fab None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:08.981922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c26c-774f-4622-8683-e5c099f81fab None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:08.982463 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c26c-774f-4622-8683-e5c099f81fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.009218 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-d2d9c26c-774f-4622-8683-e5c099f81fab None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:09.010498 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d2d9c26c-774f-4622-8683-e5c099f81fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.053047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:09.090962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1328/2663] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:09.100976 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:09.102899 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.170122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3101683-5f82-445d-b560-be2c70c79388 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:09.174300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:09.175005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.175326 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.175607 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.183886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:09.186641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:09.188723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13968126-4c8d-4c3b-adf7-de9f0e867766 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:09.203870 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1336/2664] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:09.293776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.294394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.295275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.297851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1329/2665] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:53:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:53:09.304484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e01b-8884-4928-8eac-9cde9ba216a0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.304767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e01b-8884-4928-8eac-9cde9ba216a0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.305349 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3e01b-8884-4928-8eac-9cde9ba216a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.327715 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-69c3e01b-8884-4928-8eac-9cde9ba216a0 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:09.329654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-69c3e01b-8884-4928-8eac-9cde9ba216a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.445914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1337/2666] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:09.466573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:09.469416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.558183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc280f-c510-4975-bd16-92070d5a8242 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:09.563037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:09.563993 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.564305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.564647 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.593621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:09.595543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801e2af-9425-496c-811d-16a4fada54a7 service glance] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:09.610903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1330/2667] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:09.691739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.691739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.692480 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] PATH_INFO: `/` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.694100 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1338/2668] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:53:09.701405 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede333-8301-4837-9e83-5f65ee766f31 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.701757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede333-8301-4837-9e83-5f65ee766f31 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.702281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aede333-8301-4837-9e83-5f65ee766f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.732830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4aede333-8301-4837-9e83-5f65ee766f31 None None] MFA Rules not processed for user `51413215fe6d42f7a76a6764c2a993cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:09.734220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4aede333-8301-4837-9e83-5f65ee766f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.743448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1331/2669] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:09.764074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:09.766370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:09.784829 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b515b0-cc7e-4f53-a4ee-266a6ac95248 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:09.795485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:09.795485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.795485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.795485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.807938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:09.810239 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef00f48-efe4-4f7f-b4ca-053d4e97c2de service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:09.823306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1339/2670] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:09.964933 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564098-1b36-44b0-8a5b-683f17b03f02 None None] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.965253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564098-1b36-44b0-8a5b-683f17b03f02 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.965720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75564098-1b36-44b0-8a5b-683f17b03f02 None None] PATH_INFO: `/` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:09.967101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1332/2671] 10.222.0.48 () {54 vars in 921 bytes} [Tue Jun 28 17:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 28 17:53:09.974247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc9a0-105f-4f92-8eef-7159385d97c9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:09.974708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc9a0-105f-4f92-8eef-7159385d97c9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:09.975077 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acc9a0-105f-4f92-8eef-7159385d97c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:10.000544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-46acc9a0-105f-4f92-8eef-7159385d97c9 None None] MFA Rules not processed for user `ef1eedbaa7574783adde2884c2b9a482`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:10.007739 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-46acc9a0-105f-4f92-8eef-7159385d97c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:10.038580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1340/2672] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Jun 28 17:53:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:10.045876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75564098-1b36-44b0-8a5b-683f17b03f02 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:10.064642 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75564098-1b36-44b0-8a5b-683f17b03f02 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:10.068997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:10.069416 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:10.069836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:10.070059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:10.084013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:10.085706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:10.108542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25f84-e7f2-41ff-9401-58562f91159c None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:10.109374 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25f84-e7f2-41ff-9401-58562f91159c None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:10.109820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25f84-e7f2-41ff-9401-58562f91159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:10.124051 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1333/2673] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:10.147873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4ca25f84-e7f2-41ff-9401-58562f91159c None None] MFA Rules not processed for user `436c5a5e7af9414b9017c603ae5a35d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:10.149967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4ca25f84-e7f2-41ff-9401-58562f91159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:10.261730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1341/2674] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:10.280469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:10.286831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:10.377629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d52c36-91fb-4eb2-9195-a23850d66c2a service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:10.385489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:10.386728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:10.387139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:10.387626 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:10.405448 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:10.408343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596b00a-6a8e-49c0-8812-4d5998c07bc0 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:10.430902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1334/2675] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:11.929806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:11.930395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:11.930395 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:11.949486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] MFA Rules not processed for user `436c5a5e7af9414b9017c603ae5a35d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:11.951522 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:11.958907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1342/2676] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:12.222984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.223780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.223780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.225663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:12.227302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.247125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:12.248347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.249783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab421b-7900-4ec6-a9bf-a6d1397c2317 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:12.254729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:12.255662 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.255940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.256213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] PATH_INFO: `/v3/users/372d78ad02e249389720b22adba7af68` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.257405 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] RBAC: Authorizing `identity:delete_user(user_id=372d78ad02e249389720b22adba7af68)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:12.259384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:12.312515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:12.315330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372d78ad02e249389720b22adba7af68'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:12.324816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1335/2677] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:53:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:12.325514 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372d78ad02e249389720b22adba7af68'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:12.326331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:12.326540 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372d78ad02e249389720b22adba7af68'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:12.337907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372d78ad02e249389720b22adba7af68'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:12.340661 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc5a7f-6898-4349-953d-98e205db3c00 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:12.344705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:12.345372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.345650 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.345928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.347762 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.351655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372d78ad02e249389720b22adba7af68'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:12.357735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1343/2678] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:12 2022] DELETE /identity/v3/users/372d78ad02e249389720b22adba7af68 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:12.358664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:12.358809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:12.360185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02373648-594c-4f0d-bb53-5807d76d2562 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:12.360432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.363954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:12.370540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1336/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:12.371914 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.372207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.372488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.392031 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:12.393275 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.446942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b01f34-ad7d-474c-8f50-f29707cf314e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:12.453156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:12.454360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.454657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.454938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.457409 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.470750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1337/2680] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:12.477899 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:12.479739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:12.544782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:12.546936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:12.572801 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1344/2681] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:12.575110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2899cc-6c2a-4f5b-a749-cf0425cc933e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:12.583941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:12.584863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:12.585156 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:12.585438 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:12.598388 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:12.600155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:12.616901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1338/2682] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:13.360955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:13.362996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:13.384592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd1702-9c1b-4ba3-908e-a5b8aff6ee8b service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:13.404098 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:13.405429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:13.407189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:13.407518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] PATH_INFO: `/v3/projects/60582d84e5ba4556bb0b7e4ed978ba2e` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:13.409394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60582d84e5ba4556bb0b7e4ed978ba2e)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:13.413484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:13.486251 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60582d84e5ba4556bb0b7e4ed978ba2e', 'request_id': 'req-3805191c-7b00-4119-a665-b9e126dad5f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.496030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60582d84e5ba4556bb0b7e4ed978ba2e', 'request_id': 'req-3805191c-7b00-4119-a665-b9e126dad5f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.498328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:13.508656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60582d84e5ba4556bb0b7e4ed978ba2e', 'request_id': 'req-3805191c-7b00-4119-a665-b9e126dad5f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.532781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] The token cache is being invalidate because project 60582d84e5ba4556bb0b7e4ed978ba2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:13.533474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.534340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.539319 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1345/2683] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:13 2022] DELETE /identity/v3/projects/60582d84e5ba4556bb0b7e4ed978ba2e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:13.540502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:13.551169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e231-bf31-4245-b0a3-f0f424db2dce service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:13.619483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:13.620387 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:13.620679 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:13.620992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] PATH_INFO: `/v3/users/4b337074cbcb4460acb3087cf14f84e0` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:13.622339 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b337074cbcb4460acb3087cf14f84e0)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:13.624328 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:13.684619 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:13.687850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b337074cbcb4460acb3087cf14f84e0'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.688873 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b337074cbcb4460acb3087cf14f84e0'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.689667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b337074cbcb4460acb3087cf14f84e0'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.697084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b337074cbcb4460acb3087cf14f84e0'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.706418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1808982c-6b8c-4f1b-a1a7-1f7cee3f75ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b337074cbcb4460acb3087cf14f84e0'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:13.734048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1339/2684] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:13 2022] DELETE /identity/v3/users/4b337074cbcb4460acb3087cf14f84e0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:14.075234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.076880 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:14.124822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805191c-7b00-4119-a665-b9e126dad5f3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.205129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.206290 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.206666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.206964 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] PATH_INFO: `/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.208209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea49e45aa74d4ac6a964c8d6e511d50f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.210208 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.263623 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea49e45aa74d4ac6a964c8d6e511d50f', 'request_id': 'req-c64def91-8fbd-4bd0-8fd2-9de4eac28715'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:14.269277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea49e45aa74d4ac6a964c8d6e511d50f', 'request_id': 'req-c64def91-8fbd-4bd0-8fd2-9de4eac28715'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:14.275640 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea49e45aa74d4ac6a964c8d6e511d50f', 'request_id': 'req-c64def91-8fbd-4bd0-8fd2-9de4eac28715'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:14.288748 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] The token cache is being invalidate because project ea49e45aa74d4ac6a964c8d6e511d50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:14.289041 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:14.289710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-c64def91-8fbd-4bd0-8fd2-9de4eac28715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:14.291288 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1346/2685] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:14 2022] DELETE /identity/v3/projects/ea49e45aa74d4ac6a964c8d6e511d50f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:14.296582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.296876 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.297256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.343030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:14.344319 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:14.440845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1340/2686] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:14.449286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.449861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.449861 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.475666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:14.476926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:14.497399 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1347/2687] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:14.502084 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.512944 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177eecb-25bc-4c33-8ec3-74b28ec70a33 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.518372 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.519075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.519344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.519633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.520364 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:14.520673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.522464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.541460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.546424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1341/2688] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:14.553315 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa14a67-5169-48b0-bf1d-d2316bae9c59 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.558504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.559279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.559504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.559874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.560584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.562802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.601453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1348/2689] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:14 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:14.605767 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.618570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78236-afe1-4890-a84d-6418a8b58045 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.721233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.722284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.722731 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.723154 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.724026 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.726484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.762030 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1342/2690] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:14 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:53:14.762978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.781173 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23388a5f-18c9-4684-b8de-604a587bf7a3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.786683 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.787366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.787711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.788048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.788852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.790512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.802025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1349/2691] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:53:14.805977 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.817812 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dc06d-9eb6-486f-aacc-b58ee08a9817 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.824254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.825357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.825713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.826101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.826911 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.828857 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190adb0a-0a55-46bf-9938-a71aa408f808 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.842227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1343/2692] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:14.852064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:14.865035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590ad3f-3fda-4ef6-a123-b42c8c15f073 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:14.869993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:14.870988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.871272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.871548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] PATH_INFO: `/v3/projects/24eeca01e95a4a80aff401464b6e522a/users/651685a86b5d457d81380e875aeafb00/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.887046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24eeca01e95a4a80aff401464b6e522a, user_id=651685a86b5d457d81380e875aeafb00, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:14.889695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:14.916088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1350/2693] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:14 2022] PUT /identity/v3/projects/24eeca01e95a4a80aff401464b6e522a/users/651685a86b5d457d81380e875aeafb00/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:14.919032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:14.919327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:14.919613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:14.965786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] MFA Rules not processed for user `651685a86b5d457d81380e875aeafb00`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:14.967301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:14.984549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:15.063452 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1344/2694] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:15.075431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:15.077446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:15.094324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:15.152035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c922-68fd-4e96-8a89-5982a7a42c10 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:15.157026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:15.157787 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:15.158075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:15.158418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:15.170602 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:15.172636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadd1be-6666-406c-bc5d-0225443cf1f1 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:15.182917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1351/2695] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:18.596771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:18.683209 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4705909-2334-4365-b6a8-58ef39f69344 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:18.689072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:18.690456 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:18.690882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:18.691293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] PATH_INFO: `/v3/users/651685a86b5d457d81380e875aeafb00` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:18.694883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651685a86b5d457d81380e875aeafb00)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:18.697040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:18.784306 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651685a86b5d457d81380e875aeafb00'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:18.785667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651685a86b5d457d81380e875aeafb00'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:18.786721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651685a86b5d457d81380e875aeafb00'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:18.796764 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651685a86b5d457d81380e875aeafb00'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:18.806056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651685a86b5d457d81380e875aeafb00'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:18.845837 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1345/2696] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:18 2022] DELETE /identity/v3/users/651685a86b5d457d81380e875aeafb00 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:18.850268 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:18.850779 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:18.850871 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:18.872967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:18.874463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:18.946513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1352/2697] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:18.957224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:18.958824 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:19.008039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:19.030831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45aeb8-4dbe-4652-957b-f9b2392ea4e0 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:19.034835 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:19.035506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.035791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.036056 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.047550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:19.049037 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97d5f-cc7f-46b0-90a1-bc59ecea8549 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:19.060312 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1346/2698] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:19.466711 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:19.469677 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:19.484695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786ac4-8844-4e11-b984-9845320a3b30 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:19.490165 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:19.491138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.491567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.492088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] PATH_INFO: `/v3/projects/24eeca01e95a4a80aff401464b6e522a` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.509605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24eeca01e95a4a80aff401464b6e522a)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:19.512013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:19.582630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eeca01e95a4a80aff401464b6e522a', 'request_id': 'req-70a42a60-2ee8-4d4e-932d-5039a375cfe7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:19.590023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eeca01e95a4a80aff401464b6e522a', 'request_id': 'req-70a42a60-2ee8-4d4e-932d-5039a375cfe7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:19.597684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eeca01e95a4a80aff401464b6e522a', 'request_id': 'req-70a42a60-2ee8-4d4e-932d-5039a375cfe7'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:19.614712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] The token cache is being invalidate because project 24eeca01e95a4a80aff401464b6e522a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:19.615064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:19.615966 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-70a42a60-2ee8-4d4e-932d-5039a375cfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:19.617986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1353/2699] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:19 2022] DELETE /identity/v3/projects/24eeca01e95a4a80aff401464b6e522a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:19.629664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.629664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.629664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.644040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:19.645356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:19.743266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1347/2700] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:19.751483 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.751744 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.752066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.778092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:19.778092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:19.789023 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1354/2701] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:19.790296 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:19.802120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a5ecf-75ad-4851-ae6a-5ad0e9e290db None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:19.809264 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:19.810350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.810495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.810743 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.811487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:19.811830 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:19.813511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:19.827644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1348/2702] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:19.831249 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:19.841451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbc0f1-df6a-4008-b299-42a151cf7a1d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:19.847438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:19.848203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.848503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.848874 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.849743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:19.851942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:19.883388 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1355/2703] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:19 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:19.887551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:19.898570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996c604-9e64-4b70-88c0-225962c69996 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:19.965008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:19.965790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:19.966162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:19.966529 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:19.967281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:19.969283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:19.991054 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1349/2704] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:19 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:19.996038 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.016621 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e007e-1e32-4c1d-8519-d74c28788b07 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.022418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.023129 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.023453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.023691 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.024442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.026558 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.032843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:20.039705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1356/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:20.044407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.056964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7bc8a-dd81-40a6-ab93-0257f05e8f4c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.062644 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.063505 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.063763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.064046 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.064786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.066503 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f12e6-d53b-40d4-84dd-8edb4f321ba7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.080566 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1350/2706] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:20.084672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.098250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119e9c6-4661-4084-a58b-f501aa5b42ef admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.104724 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.105693 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.106079 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.106354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] PATH_INFO: `/v3/projects/88a6c53b3e064eb2b124de1c7832c4de/users/6a79d2111afa48e3bc17378ad4cdd695/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.125825 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a6c53b3e064eb2b124de1c7832c4de, user_id=6a79d2111afa48e3bc17378ad4cdd695, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.131298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.156196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1357/2707] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:20 2022] PUT /identity/v3/projects/88a6c53b3e064eb2b124de1c7832c4de/users/6a79d2111afa48e3bc17378ad4cdd695/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:20.169074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.169359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.169659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.213377 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] MFA Rules not processed for user `6a79d2111afa48e3bc17378ad4cdd695`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:20.214717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:20.251909 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:20.305509 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1351/2708] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:20.306849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.387430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e161d6-e747-47e0-8f58-0719b0dc3d91 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.392853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.393526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.393807 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.394112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.394832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.396719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.431189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1358/2709] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:20 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:20.436334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.464627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff7e39-b5af-4dae-b004-f1a5ef5bfd1c None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.584610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.585190 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.585575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.586068 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.586997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.591530 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.630862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1352/2710] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:20 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:20.635338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.657227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4026-d838-44bc-8749-e428ab223ad0 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.670897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.671769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.672071 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.672426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.673179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.674910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.692936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1359/2711] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:20.697317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.733683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeef6e-43da-462e-be66-6bb2e2227a0c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.742299 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.743587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.744151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.744594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.746082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.750201 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178296-a7d9-4262-bc39-d04802bb28c6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.778348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1353/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:20.780920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:20.806898 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679b1fe-172e-4bed-82da-edaab96441dd admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:20.826941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:20.828698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.833431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.835484 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] PATH_INFO: `/v3/projects/c5e1ee20495343f6864ee3aa28436eb3/users/45c1b952e6c841c79e37695b63628637/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.903509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e1ee20495343f6864ee3aa28436eb3, user_id=45c1b952e6c841c79e37695b63628637, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:20.908796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:20.946042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1360/2713] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:20 2022] PUT /identity/v3/projects/c5e1ee20495343f6864ee3aa28436eb3/users/45c1b952e6c841c79e37695b63628637/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:20.956723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:20.957038 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:20.957286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:20.989663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] MFA Rules not processed for user `45c1b952e6c841c79e37695b63628637`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:20.990974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:21.074470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1354/2714] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:21.080086 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.160084 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461d8d2-6c6a-4e5e-9dea-2e6814ee7dbe admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.167609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.168708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.169171 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.169628 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.170905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.174605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.209782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1361/2715] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:21 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:21.216001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.232170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1563ef2-7554-4043-9ce2-0d34f88c47e3 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.291221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:21.323997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.324792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.325373 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.325717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.326572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.329335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.360139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1355/2716] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:21 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:21.364681 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.397571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52003b-1c56-4352-9ce9-e2bb7f1f1cad admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.404007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.404742 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.405033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.405281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.406247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.408414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.415370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:21.427661 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1362/2717] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:21.428560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.440071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7b39-80c2-4770-b4f0-a7789048185a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.444890 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.446023 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.446315 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.446611 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] PATH_INFO: `/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8/users/b9f26bec0dfe4187a6c2d6ea36fa7b30/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.464595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6b682a77584b40a9b1d53f1732d8c8, user_id=b9f26bec0dfe4187a6c2d6ea36fa7b30, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.467338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.483839 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1356/2718] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:21 2022] PUT /identity/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8/users/b9f26bec0dfe4187a6c2d6ea36fa7b30/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:53:21.487948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.502003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43182b-588e-42fc-a4ef-226daebd5b5a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.586695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.588017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.588306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.588584 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.589368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.591457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ce34-fa86-4fad-af0f-e2839b0be7e9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.608925 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1363/2719] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:21.613633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.626178 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64271b-fdc6-44e5-a74a-d8d6e9c5c42e admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.632375 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.633302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.633586 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.633865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] PATH_INFO: `/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8/users/b9f26bec0dfe4187a6c2d6ea36fa7b30/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.636024 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6b682a77584b40a9b1d53f1732d8c8, user_id=b9f26bec0dfe4187a6c2d6ea36fa7b30, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:21.638870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:21.656490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1357/2720] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:21 2022] PUT /identity/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8/users/b9f26bec0dfe4187a6c2d6ea36fa7b30/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:21.667706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.667954 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.668094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:21.698806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] MFA Rules not processed for user `b9f26bec0dfe4187a6c2d6ea36fa7b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:21.700117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:21.793080 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1364/2721] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:21.805010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:21.806836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:21.888424 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5d35e-dbf6-434a-bd70-53732835df9a admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:21.893908 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:21.895119 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:21.895905 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:21.896420 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:22.007666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:22.011001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:22.023565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1358/2722] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:23.670980 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:23.672890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:23.686820 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925d858-60e6-4750-805e-aeb870ca379e None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:23.691278 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:23.691941 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:23.692300 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:23.692582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:23.759596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:23.761008 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d02ce-ce60-4bee-8147-3efec4d89338 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:23.771846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1365/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:24.409825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:24.424841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d4018-f5ff-4d48-9c13-e3efdd952461 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:24.430231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:24.430915 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:24.431192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:24.431472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:24.443243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:24.444783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:24.456261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1359/2724] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:28.388184 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:28.388762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:28.388762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:28.408927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:28.410443 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:28.429695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:28.478457 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1366/2725] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:28.503701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:28.505522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:28.561282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:28.575912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:28.609820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cb9fd-a38e-4733-a1ff-14c219edfd9c service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:28.623747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:28.624663 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:28.626938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:28.626938 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:28.643326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:28.648635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db298c-6901-43ee-9313-d7f12c90e878 service swift] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:28.665916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934eb74-fde4-4bc8-92cc-a81941cd2309 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:28.668874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1360/2726] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:53:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:28.674721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:28.676250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:28.676714 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:28.677131 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] PATH_INFO: `/v3/users/6a79d2111afa48e3bc17378ad4cdd695` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:28.679010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a79d2111afa48e3bc17378ad4cdd695)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:28.681636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:28.788106 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a79d2111afa48e3bc17378ad4cdd695'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:28.798975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a79d2111afa48e3bc17378ad4cdd695'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:28.802904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a79d2111afa48e3bc17378ad4cdd695'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:28.816192 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a79d2111afa48e3bc17378ad4cdd695'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:28.846275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a79d2111afa48e3bc17378ad4cdd695'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:28.859428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1367/2727] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:28 2022] DELETE /identity/v3/users/6a79d2111afa48e3bc17378ad4cdd695 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:28.864386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:28.864722 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:28.864975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:28.897957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:28.901363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:29.002772 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1361/2728] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:29.015669 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:29.018024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:29.119120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:29.142013 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac6725-39d5-425d-a53d-89df78e692a1 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:29.148424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:29.149179 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:29.149530 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:29.149746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:29.166989 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:29.171799 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:29.190383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1368/2729] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:29.701502 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:29.703512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:29.716012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bbf5-6e6a-496f-9fe3-231150d98a1f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:29.722239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:29.723237 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:29.723681 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:29.723980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] PATH_INFO: `/v3/projects/88a6c53b3e064eb2b124de1c7832c4de` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:29.725298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a6c53b3e064eb2b124de1c7832c4de)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:29.727322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:29.797658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a6c53b3e064eb2b124de1c7832c4de', 'request_id': 'req-e7f1ab5b-7963-4699-aa58-08299f229e28'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.804219 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a6c53b3e064eb2b124de1c7832c4de', 'request_id': 'req-e7f1ab5b-7963-4699-aa58-08299f229e28'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.811489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a6c53b3e064eb2b124de1c7832c4de', 'request_id': 'req-e7f1ab5b-7963-4699-aa58-08299f229e28'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.827001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] The token cache is being invalidate because project 88a6c53b3e064eb2b124de1c7832c4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:29.827363 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.828256 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.830082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1362/2730] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:29 2022] DELETE /identity/v3/projects/88a6c53b3e064eb2b124de1c7832c4de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:29.834689 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:29.848162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3580-05b5-4e82-9f7d-51d300574b12 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:29.920838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:29.922285 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:29.922629 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:29.922937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] PATH_INFO: `/v3/users/45c1b952e6c841c79e37695b63628637` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:29.924305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c1b952e6c841c79e37695b63628637)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:29.926311 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:29.978033 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c1b952e6c841c79e37695b63628637'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.986262 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c1b952e6c841c79e37695b63628637'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.987051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c1b952e6c841c79e37695b63628637'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:29.997264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c1b952e6c841c79e37695b63628637'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.011818 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c1b952e6c841c79e37695b63628637'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.020505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1369/2731] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:29 2022] DELETE /identity/v3/users/45c1b952e6c841c79e37695b63628637 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:30.370286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:30.372693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:30.392919 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1ab5b-7963-4699-aa58-08299f229e28 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:30.457596 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:30.475124 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:30.476020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:30.476297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:30.476587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] PATH_INFO: `/v3/projects/c5e1ee20495343f6864ee3aa28436eb3` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:30.478186 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e1ee20495343f6864ee3aa28436eb3)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:30.481116 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:30.536297 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e1ee20495343f6864ee3aa28436eb3', 'request_id': 'req-892b17c5-7e3b-4d53-8c08-392f377a2f2b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.542496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e1ee20495343f6864ee3aa28436eb3', 'request_id': 'req-892b17c5-7e3b-4d53-8c08-392f377a2f2b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.550805 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e1ee20495343f6864ee3aa28436eb3', 'request_id': 'req-892b17c5-7e3b-4d53-8c08-392f377a2f2b'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.565982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] The token cache is being invalidate because project c5e1ee20495343f6864ee3aa28436eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:30.566331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.567151 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.572317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1363/2732] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:30 2022] DELETE /identity/v3/projects/c5e1ee20495343f6864ee3aa28436eb3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:30.573568 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:30.575180 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:30.588841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c818fe-d5bd-4252-b713-41aeb34c1635 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:30.663493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:30.664832 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:30.665476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:30.665476 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] PATH_INFO: `/v3/users/b9f26bec0dfe4187a6c2d6ea36fa7b30` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:30.667095 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f26bec0dfe4187a6c2d6ea36fa7b30)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:30.670323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:30.678875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:30.732703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f26bec0dfe4187a6c2d6ea36fa7b30'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.741196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f26bec0dfe4187a6c2d6ea36fa7b30'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.742006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f26bec0dfe4187a6c2d6ea36fa7b30'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.753256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f26bec0dfe4187a6c2d6ea36fa7b30'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.781431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-edc7dce0-d843-401f-8d7f-4958c77e024b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f26bec0dfe4187a6c2d6ea36fa7b30'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:30.798838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1370/2733] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:30 2022] DELETE /identity/v3/users/b9f26bec0dfe4187a6c2d6ea36fa7b30 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:31.232288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.234011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:31.253913 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b17c5-7e3b-4d53-8c08-392f377a2f2b admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.322941 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.323845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.324129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.324409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] PATH_INFO: `/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.326125 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6b682a77584b40a9b1d53f1732d8c8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.328282 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.382134 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6b682a77584b40a9b1d53f1732d8c8', 'request_id': 'req-21970d2c-6928-44c5-adb6-2d4e9c96049f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:31.388361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6b682a77584b40a9b1d53f1732d8c8', 'request_id': 'req-21970d2c-6928-44c5-adb6-2d4e9c96049f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:31.395637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6b682a77584b40a9b1d53f1732d8c8', 'request_id': 'req-21970d2c-6928-44c5-adb6-2d4e9c96049f'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:31.410361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] The token cache is being invalidate because project 3f6b682a77584b40a9b1d53f1732d8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:31.410648 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:31.411310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-21970d2c-6928-44c5-adb6-2d4e9c96049f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:31.412894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1364/2734] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:31 2022] DELETE /identity/v3/projects/3f6b682a77584b40a9b1d53f1732d8c8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:31.418426 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.419007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.419007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.438762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:31.439991 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:31.507139 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1371/2735] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:31.516294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.516579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.516863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.538259 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:31.539443 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:31.548564 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1365/2736] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:31.553357 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.564887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043f3e4-da22-410b-ad02-6de2c663709d None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.572923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.574178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.574595 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.574936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.575932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:31.576430 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.578284 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.594390 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1372/2737] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:31.598939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.603705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:31.610290 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a508e4f-9efa-4b7a-bbc3-1ea7ad8e55d4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.617608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.618487 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.618810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.619091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.619851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.622143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.656557 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1366/2738] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:31 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:31.661565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.673913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4924966-aa25-4e40-8360-067410296f58 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.737977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.738706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.738983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.739256 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.739944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.741889 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.769542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1373/2739] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:31 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:31.773997 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.786594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e430b94-ad55-4a98-9246-ee7b04100be3 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.792195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.793091 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.793413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.793770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.794637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.796608 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.808746 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1367/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:31.813605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.819296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:31.825557 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa0d33-4b06-4a66-bb15-edf0b5075d5c admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.833583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.834814 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.835339 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.836024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.836785 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.838464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd442a5c-bef9-40a2-b072-d73a32f8d11b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.850694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1374/2741] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:31.855096 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:31.866500 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c6c66-0c0e-4042-9e97-c87b9e750b10 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:31.872274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:31.873221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.873480 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.873786 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] PATH_INFO: `/v3/projects/9ac1e82965c145068256db398e8a8949/users/2e1ebf9a776048a1aa6b040071de0653/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.893311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac1e82965c145068256db398e8a8949, user_id=2e1ebf9a776048a1aa6b040071de0653, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:31.896071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:31.914274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1368/2742] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:31 2022] PUT /identity/v3/projects/9ac1e82965c145068256db398e8a8949/users/2e1ebf9a776048a1aa6b040071de0653/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:31.926087 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7e01-c6d7-498b-830b-2381e44dd350 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:31.926460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7e01-c6d7-498b-830b-2381e44dd350 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:31.926765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7e01-c6d7-498b-830b-2381e44dd350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:31.966020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-62ae7e01-c6d7-498b-830b-2381e44dd350 None None] MFA Rules not processed for user `2e1ebf9a776048a1aa6b040071de0653`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:31.967306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-62ae7e01-c6d7-498b-830b-2381e44dd350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:32.046094 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1375/2743] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:32.058403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:32.060381 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:32.126127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422967d7-07a4-4235-bad7-71ebef4fab33 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:32.130020 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:32.130719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:32.130967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:32.131283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:32.142136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:32.143659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8de3e8-769f-42f8-93c3-2b996a12d41c service glance] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:32.154501 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1369/2744] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:53:37.401366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:37.401834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:37.402018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:37.421337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] MFA Rules not processed for user `436c5a5e7af9414b9017c603ae5a35d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:37.422632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:37.492450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1376/2745] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:42.149418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:47.484758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=61 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:55.320166 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:55.320748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:55.320748 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:55.340361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:55.341506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:55.403081 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1370/2746] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:55.416282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:55.417735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:55.501136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d06d7d-c27d-48c6-b5e4-0eeab9cf3a6b None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:55.509931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:55.511005 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:55.511384 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:55.511793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:55.527187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:55.529605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841352e-9e65-46c0-b074-969a0c542ae8 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:55.543767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1377/2747] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:53:55.723335 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:55.845266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac000ad-4e7f-4af9-99ad-6b16cdfc2c58 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:55.855361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:55.856412 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:55.856763 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:55.857145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] PATH_INFO: `/v3/users/2e1ebf9a776048a1aa6b040071de0653` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:55.863460 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1ebf9a776048a1aa6b040071de0653)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:55.865726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:55.955926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1ebf9a776048a1aa6b040071de0653'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:55.957061 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1ebf9a776048a1aa6b040071de0653'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:55.958160 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1ebf9a776048a1aa6b040071de0653'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:55.971228 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1ebf9a776048a1aa6b040071de0653'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:55.982105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1ebf9a776048a1aa6b040071de0653'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.009071 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1371/2748] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:53:55 2022] DELETE /identity/v3/users/2e1ebf9a776048a1aa6b040071de0653 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:56.015236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:56.016323 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:56.016939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:56.047347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:56.049591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:56.167839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1378/2749] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:56.169790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:56.173107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:56.226272 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:56.284815 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24d29d-7740-4035-9c9a-407bc71c489d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:56.290089 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:56.290939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:56.291260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:56.291560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:56.302956 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:56.304558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce36cb-09fd-43c9-baf4-bff35e60ee81 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:56.324721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1372/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:53:56.786931 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:56.790473 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:56.806955 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be4af8-784e-4fe0-b210-5523014cd8b6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:56.814040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:56.815121 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:56.815381 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:56.815653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] PATH_INFO: `/v3/projects/9ac1e82965c145068256db398e8a8949` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:56.817057 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac1e82965c145068256db398e8a8949)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:56.819045 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:56.892338 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac1e82965c145068256db398e8a8949', 'request_id': 'req-be94bbcc-1149-440a-82d2-48e2a0e9ff52'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.899332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac1e82965c145068256db398e8a8949', 'request_id': 'req-be94bbcc-1149-440a-82d2-48e2a0e9ff52'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.906754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac1e82965c145068256db398e8a8949', 'request_id': 'req-be94bbcc-1149-440a-82d2-48e2a0e9ff52'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.934593 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] The token cache is being invalidate because project 9ac1e82965c145068256db398e8a8949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:53:56.934853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.937556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-be94bbcc-1149-440a-82d2-48e2a0e9ff52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:53:56.941103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1379/2751] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:53:56 2022] DELETE /identity/v3/projects/9ac1e82965c145068256db398e8a8949 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:56.946675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:56.948221 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:56.948610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:56.975538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:56.976779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:57.078138 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1373/2752] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:57.082704 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.083136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.083651 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.108614 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:57.110921 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:57.127383 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1380/2753] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:53:57.130658 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.144680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b577610-02e9-42ca-9ec7-26b8fbabfd69 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.153521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.155534 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.156169 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.157570 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.158818 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:53:57.159667 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.163268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.185055 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1374/2754] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:53:57.190474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.201524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19044-fa51-4377-a498-244f7a4a5021 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.212306 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.213416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.213886 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.214246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.215194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.218548 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.223963 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:57.260684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1381/2755] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:53:57 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:53:57.265105 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.284082 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabeacf-f88d-4e53-9ed1-a0b079058d94 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.367175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.368163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.368163 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.368430 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.369255 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.371418 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.404127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1375/2756] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:53:57 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:53:57.405526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.426920 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dd3d3-cd27-488e-a749-de806ee973f5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.435176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.436299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.436659 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.436946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.439255 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.441107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.465337 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1382/2757] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:57.466894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.481092 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee098-1900-414c-b259-b8a0cb6ca0e8 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.487398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.488543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.489281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.489771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.491668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.493990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f31dd4-a56a-435e-80f6-d8e8a9a80634 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.511439 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1376/2758] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:53:57.512060 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.526719 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd84b82-cf60-4404-b43c-9c86ed6e1ce3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.539743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.540690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.540973 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.541252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] PATH_INFO: `/v3/projects/d113a4c9d8c84cab9f28642d6bf88a8b/users/7f73988a5de0481eaf20f68b9f6a0489/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.565910 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d113a4c9d8c84cab9f28642d6bf88a8b, user_id=7f73988a5de0481eaf20f68b9f6a0489, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.566196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.586869 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1383/2759] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:53:57 2022] PUT /identity/v3/projects/d113a4c9d8c84cab9f28642d6bf88a8b/users/7f73988a5de0481eaf20f68b9f6a0489/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:53:57.598589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.598929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.599115 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.632199 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] MFA Rules not processed for user `7f73988a5de0481eaf20f68b9f6a0489`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:53:57.633398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:57.658846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:53:57.716446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1377/2760] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:53:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:53:57.730808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:53:57.732616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:53:57.815177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bc6e3-ec21-4d87-a0f6-ac401834608e admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:53:57.820699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:53:57.821701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:53:57.822081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:53:57.822511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:53:57.834851 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:53:57.835115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdd0ce-41f8-4618-8c56-2b0a27bd8de4 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:53:57.846024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1384/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:53:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:54:03.265425 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:03.363005 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e918-d481-4d5a-812d-f0f6856011f4 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:03.368311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:03.369231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:03.369521 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:03.369779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] PATH_INFO: `/v3/users/7f73988a5de0481eaf20f68b9f6a0489` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:03.371305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f73988a5de0481eaf20f68b9f6a0489)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:03.373286 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:03.447567 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f73988a5de0481eaf20f68b9f6a0489'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:03.448207 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f73988a5de0481eaf20f68b9f6a0489'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:03.448892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f73988a5de0481eaf20f68b9f6a0489'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:03.458927 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f73988a5de0481eaf20f68b9f6a0489'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:03.471970 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f73988a5de0481eaf20f68b9f6a0489'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:03.513090 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1378/2762] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:54:03 2022] DELETE /identity/v3/users/7f73988a5de0481eaf20f68b9f6a0489 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:03.519157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:03.519157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:03.519157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:03.538360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:03.542437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:03.630331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1385/2763] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:54:03.640719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:03.642471 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:03.778922 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:03.803485 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98250-e70e-4ca4-b7ba-3a0b80b5448c admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:03.807347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:03.808025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:03.808304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:03.808577 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:03.823175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:03.824726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458d41-4b9c-4a1f-a316-2efe48855827 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:03.839484 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1379/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:04.400766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:04.400766 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:04.431479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1379378-baa7-4fbe-96f1-9eb81e785fe8 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:04.431479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:04.433656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:04.433656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:04.433656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] PATH_INFO: `/v3/projects/d113a4c9d8c84cab9f28642d6bf88a8b` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:04.435438 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d113a4c9d8c84cab9f28642d6bf88a8b)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:04.449764 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:04.551442 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:04.553771 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd113a4c9d8c84cab9f28642d6bf88a8b', 'request_id': 'req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:04.566431 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd113a4c9d8c84cab9f28642d6bf88a8b', 'request_id': 'req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:04.589089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd113a4c9d8c84cab9f28642d6bf88a8b', 'request_id': 'req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:04.630227 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] The token cache is being invalidate because project d113a4c9d8c84cab9f28642d6bf88a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:54:04.631272 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:04.633277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:04.637523 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1386/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:54:04 2022] DELETE /identity/v3/projects/d113a4c9d8c84cab9f28642d6bf88a8b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:12.182560 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:12.183294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:12.183294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:12.204716 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:12.205975 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:12.279862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1380/2766] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:54:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:54:12.298892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:12.301385 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:12.415695 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74016dce-e7ec-41f3-bf6c-7d42cd9ed0f3 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:12.423279 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:12.423986 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:12.424264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:12.424536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:12.434042 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:12.435733 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:12.445675 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1387/2767] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:54:14.622268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:14.626671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:14.724331 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eba5ce-c884-46c7-ad99-7ee88aeac41a None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:14.736836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:14.738394 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:14.738843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:14.739234 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] PATH_INFO: `/v3/users/436c5a5e7af9414b9017c603ae5a35d8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:14.741291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436c5a5e7af9414b9017c603ae5a35d8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:14.744545 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:14.846047 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436c5a5e7af9414b9017c603ae5a35d8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:14.846634 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436c5a5e7af9414b9017c603ae5a35d8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:14.847270 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436c5a5e7af9414b9017c603ae5a35d8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:14.855894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436c5a5e7af9414b9017c603ae5a35d8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:14.868356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436c5a5e7af9414b9017c603ae5a35d8'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:14.913674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1381/2768] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:54:14 2022] DELETE /identity/v3/users/436c5a5e7af9414b9017c603ae5a35d8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:15.172439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:15.199533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9a622-0146-462f-9788-9a48148f834e service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:15.293772 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:15.295225 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:15.295543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:15.295819 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] PATH_INFO: `/v3/projects/339057e36e6b40b9ba194b0e463f6f58` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:15.297218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=339057e36e6b40b9ba194b0e463f6f58)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:15.301277 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:15.371763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339057e36e6b40b9ba194b0e463f6f58', 'request_id': 'req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:15.379474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339057e36e6b40b9ba194b0e463f6f58', 'request_id': 'req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:15.387605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339057e36e6b40b9ba194b0e463f6f58', 'request_id': 'req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:15.395541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:15.408903 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] The token cache is being invalidate because project 339057e36e6b40b9ba194b0e463f6f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:54:15.409250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:15.410236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:15.411863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1388/2769] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:54:15 2022] DELETE /identity/v3/projects/339057e36e6b40b9ba194b0e463f6f58 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:16.161751 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:16.163912 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:16.178729 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:16.236329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e0c87-c5bf-4dbc-819a-a02fa8be0fe2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:16.290449 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:16.291183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:16.291508 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:16.291831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:16.294122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:16.366000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:16.368665 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:16.379760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1382/2770] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:17.397518 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:17.400199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:17.495140 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9ef8b-bac5-41c4-8cb2-edb3b1c15ccf admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:17.503936 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:17.504632 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:17.504960 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:17.505224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:17.507246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:17.525050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:17.527275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:17.558727 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1389/2771] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:18.262248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:18.263727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:18.275902 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c709ef-0dd3-43fb-8597-9147a6984cb8 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:18.280008 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:18.280836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:18.281158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:18.281435 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:18.283691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:18.361495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:18.363074 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:18.374398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1383/2772] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:22.408066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:22.409815 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:22.424320 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddab175-791b-4b4d-a448-be44b4948e1c service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:22.429370 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:22.430312 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:22.430590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:22.430863 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] PATH_INFO: `/v3/users/832905930aa14f328e0d87f424afbaea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:22.432081 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832905930aa14f328e0d87f424afbaea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:22.434056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:22.487056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832905930aa14f328e0d87f424afbaea'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.494233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832905930aa14f328e0d87f424afbaea'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.500389 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832905930aa14f328e0d87f424afbaea'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.513694 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832905930aa14f328e0d87f424afbaea'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.526959 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832905930aa14f328e0d87f424afbaea'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.534343 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1390/2773] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:54:22 2022] DELETE /identity/v3/users/832905930aa14f328e0d87f424afbaea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:22.736446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:22.747239 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b557-2720-4efd-93e2-d9d18247da96 service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:22.762635 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:22.762985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:22.764586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:22.833078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ccbfed-f008-4099-902f-dc42611a7923 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:22.836781 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:22.837520 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:22.837737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:22.838048 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:22.839441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:22.839875 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:22.840496 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:22.840820 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:22.841109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] PATH_INFO: `/v3/projects/607c2d028ef84f23bb7ab7be72b64f8f` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:22.842478 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607c2d028ef84f23bb7ab7be72b64f8f)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:22.844467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:22.851862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:22.856737 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:22.858713 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d51a4-6a5c-4428-979c-cfa75f631eba service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:22.871924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1391/2774] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:22.903540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607c2d028ef84f23bb7ab7be72b64f8f', 'request_id': 'req-1737191a-69ab-4747-97ea-344c71f8c2d4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.909719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607c2d028ef84f23bb7ab7be72b64f8f', 'request_id': 'req-1737191a-69ab-4747-97ea-344c71f8c2d4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.916489 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607c2d028ef84f23bb7ab7be72b64f8f', 'request_id': 'req-1737191a-69ab-4747-97ea-344c71f8c2d4'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.931217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] The token cache is being invalidate because project 607c2d028ef84f23bb7ab7be72b64f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:54:22.931217 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.931695 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-1737191a-69ab-4747-97ea-344c71f8c2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:22.933497 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1384/2775] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:54:22 2022] DELETE /identity/v3/projects/607c2d028ef84f23bb7ab7be72b64f8f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:22.938784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:22.939124 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:22.939386 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:22.960017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:22.961360 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:23.030641 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1392/2776] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:54:23.039153 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.039415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.039700 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.063863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:23.065106 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:23.073883 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1385/2777] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:54:23.078996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.088855 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab2728-2dd1-4d52-a9b8-c63050fd2bfe None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.093516 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.094856 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.095137 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.095415 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.096156 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:54:23.096465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.098115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.112064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1393/2778] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:54:23.116461 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.127785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ba8a-4562-45d2-94d3-385d097fad2e None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.132717 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.133384 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.133662 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.133932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.134657 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.136583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.166348 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1386/2779] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:54:23 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:54:23.171250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.181672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bba612-9725-4225-8505-ead088d3bbd9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.243536 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.244464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.244858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.245266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.246092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.248301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.283942 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1394/2780] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:54:23 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:54:23.288135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.304045 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334055-4774-437c-be1b-c94ea45dac13 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.310928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.311750 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.312129 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.313065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.314281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.316126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.329273 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1387/2781] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:54:23.332209 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.343423 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e9db-2d64-4f4c-b536-429507be2081 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.350735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.351590 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.351877 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.352150 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.353107 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.354782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abf3b2-d8de-40e5-95a7-60cce8bca7da admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.367983 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1395/2782] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:54:23.372825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.383203 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76522c8-09e1-43cc-b84c-c7cce152e95d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.388027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.388999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.389277 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.389552 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] PATH_INFO: `/v3/projects/d2374a917e334a15a2e00f603ac6b7c8/users/17c48aa8c35f4daea029fe634cb05c58/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.405782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2374a917e334a15a2e00f603ac6b7c8, user_id=17c48aa8c35f4daea029fe634cb05c58, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.408598 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.426281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1388/2783] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:54:23 2022] PUT /identity/v3/projects/d2374a917e334a15a2e00f603ac6b7c8/users/17c48aa8c35f4daea029fe634cb05c58/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:23.432493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.433222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.433222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.456125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:23.457526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:23.526461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1396/2784] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:54:23.536974 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:23.539785 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:23.598494 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:23.616223 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2772-416e-4692-8abf-0541b136f0e9 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:23.621004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:23.622345 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:23.622629 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:23.622910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:23.633095 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:23.634671 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a2d38-f50c-4ac9-9502-b85575f30f1c service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:23.645556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1389/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:26.749997 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:26.752147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:26.775499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:26.960266 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab984c4-e236-4586-8a9f-00d093f711b0 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:26.968217 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:26.972043 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:26.973912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:26.974406 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:26.977826 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:27.010504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:27.013890 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:27.029493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1397/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:29.108035 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1410-9460-4a8c-931d-4805f551266d None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:29.108639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1410-9460-4a8c-931d-4805f551266d None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:29.108639 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1410-9460-4a8c-931d-4805f551266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:29.173322 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3cea1410-9460-4a8c-931d-4805f551266d None None] MFA Rules not processed for user `17c48aa8c35f4daea029fe634cb05c58`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:29.177107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3cea1410-9460-4a8c-931d-4805f551266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:29.347969 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1390/2787] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:54:29.366528 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:29.370089 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:29.526429 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b4441-f4ac-46c7-b459-c5611447c09a service placement] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:29.534325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:29.535125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:29.535598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:29.535911 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:29.547497 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:29.550552 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:29.561789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1398/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:32.110327 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:32.111143 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:32.111707 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:32.142026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:32.143705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:32.155826 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] MFA Rules not processed for user `17c48aa8c35f4daea029fe634cb05c58`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:54:32.157878 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:32.169052 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ec789-8e27-4ec6-916c-b68229a692a5 service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:32.173741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1391/2789] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:54:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:54:32.179521 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:32.180848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:32.181135 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:32.181420 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] PATH_INFO: `/v3/users/542485de58954e27999e2ad9d397dee8` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:32.182862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=542485de58954e27999e2ad9d397dee8)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:32.185070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:32.267058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542485de58954e27999e2ad9d397dee8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.280849 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542485de58954e27999e2ad9d397dee8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.282674 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542485de58954e27999e2ad9d397dee8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.297782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542485de58954e27999e2ad9d397dee8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.313210 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:32.321845 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542485de58954e27999e2ad9d397dee8'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.333069 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1399/2790] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:54:32 2022] DELETE /identity/v3/users/542485de58954e27999e2ad9d397dee8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:54:32.596851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:32.642816 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:32.644673 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:32.645009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a378ceb-cb1d-447c-9c32-89fc8a216b89 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:32.730147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c35-8a3b-4c1c-ba13-d33240d0f2ed admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:32.731553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:32.733535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:32.733535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:32.733535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] PATH_INFO: `/v3/projects/01fe3c7e1d2e4dd1bb110de1133b7916` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:32.735065 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01fe3c7e1d2e4dd1bb110de1133b7916)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:32.737402 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:32.738752 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:32.739418 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:32.739996 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:32.740545 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:32.744914 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:32.778493 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:32.781220 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:32.806466 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1400/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:54:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:54:32.828197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01fe3c7e1d2e4dd1bb110de1133b7916', 'request_id': 'req-add21061-e115-4e47-aca0-9decef1068f6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.838982 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01fe3c7e1d2e4dd1bb110de1133b7916', 'request_id': 'req-add21061-e115-4e47-aca0-9decef1068f6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.852613 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01fe3c7e1d2e4dd1bb110de1133b7916', 'request_id': 'req-add21061-e115-4e47-aca0-9decef1068f6'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.860415 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:32.890472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] The token cache is being invalidate because project 01fe3c7e1d2e4dd1bb110de1133b7916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:54:32.890472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.890472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:32.891400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1392/2792] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:54:32 2022] DELETE /identity/v3/projects/01fe3c7e1d2e4dd1bb110de1133b7916 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:32.897897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:32.900501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:32.927904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf68255-c3b6-4e28-b35b-e49d3972f222 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:33.002242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:33.003152 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:33.003428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:33.003699 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] PATH_INFO: `/v3/users/8d1ecde854df4c258217a7ecffdf7306` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:33.005017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1ecde854df4c258217a7ecffdf7306)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:33.007019 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:33.084241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1ecde854df4c258217a7ecffdf7306'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.102007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1ecde854df4c258217a7ecffdf7306'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.103230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1ecde854df4c258217a7ecffdf7306'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.114746 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1ecde854df4c258217a7ecffdf7306'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.135665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-50778276-72df-45ba-a9ee-b3c075df63a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1ecde854df4c258217a7ecffdf7306'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.145988 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1401/2793] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:54:32 2022] DELETE /identity/v3/users/8d1ecde854df4c258217a7ecffdf7306 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:33.474810 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:54:33.477777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:54:33.496382 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add21061-e115-4e47-aca0-9decef1068f6 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:54:33.576723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:54:33.578369 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:54:33.578936 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:54:33.579441 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] PATH_INFO: `/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:54:33.581603 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7d85a558a74f1a813ef6dc67e06b5c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:54:33.584293 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:54:33.699343 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7d85a558a74f1a813ef6dc67e06b5c', 'request_id': 'req-0da7eecd-954a-45b4-b0ef-02e8e7820636'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.717379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7d85a558a74f1a813ef6dc67e06b5c', 'request_id': 'req-0da7eecd-954a-45b4-b0ef-02e8e7820636'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.722758 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7d85a558a74f1a813ef6dc67e06b5c', 'request_id': 'req-0da7eecd-954a-45b4-b0ef-02e8e7820636'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.746078 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] The token cache is being invalidate because project 2f7d85a558a74f1a813ef6dc67e06b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:54:33.746493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.747422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:54:33.749406 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1393/2794] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:54:33 2022] DELETE /identity/v3/projects/2f7d85a558a74f1a813ef6dc67e06b5c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:54:43.140789 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:54:43.740013 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:27.188441 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69d57a-3841-46cb-bd36-f0f7fa8de97d None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:55:27.189232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69d57a-3841-46cb-bd36-f0f7fa8de97d None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:55:27.189232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69d57a-3841-46cb-bd36-f0f7fa8de97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:55:27.207987 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-bd69d57a-3841-46cb-bd36-f0f7fa8de97d None None] MFA Rules not processed for user `17c48aa8c35f4daea029fe634cb05c58`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:55:27.209187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-bd69d57a-3841-46cb-bd36-f0f7fa8de97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:55:27.268464 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1402/2795] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:55:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:55:28.432783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:55:28.434770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:55:28.507610 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7eecd-954a-45b4-b0ef-02e8e7820636 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:55:28.513428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:55:28.514122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:55:28.514413 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:55:28.514687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:55:28.516561 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:55:28.529380 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:55:28.531028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:55:28.541776 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1394/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:55:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:55:37.261824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=25 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:55:38.537202 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=32 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:28.920142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:56:28.921296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:56:28.921296 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:56:28.939784 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] MFA Rules not processed for user `17c48aa8c35f4daea029fe634cb05c58`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:56:28.940913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:56:28.949017 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1403/2797] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:56:37.853128 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:56:37.854871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:56:37.923111 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437e66-f8e0-4bb7-b2d2-260e44bac4b8 service placement] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:56:37.927874 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:56:37.928551 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:56:37.928831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:56:37.929104 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:56:37.931014 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:56:38.005390 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:56:38.006992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7d4f6-12f1-4ff9-ae21-c1007eadb9e8 service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:56:38.019126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1395/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:56:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:56:38.933822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:39.222872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:56:39.224511 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:56:39.237796 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09249a-66bf-40a2-9299-cb1770315b24 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:56:39.241721 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:56:39.242391 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:56:39.242666 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:56:39.242949 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:56:39.244808 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:56:39.260577 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:56:39.262761 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:56:39.280502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1404/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:56:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:56:48.013600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=54 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:56:49.272723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:29.484064 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:57:29.485311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:57:29.485311 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:57:29.503048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] MFA Rules not processed for user `17c48aa8c35f4daea029fe634cb05c58`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:57:29.504304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:57:29.511737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1396/2800] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:57:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:57:39.497866 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:57:42.012546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:57:42.014073 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:57:42.028813 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4dd3-fa7c-4d72-939f-06cb731cfbe5 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:57:42.035624 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:57:42.036425 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:57:42.036723 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:57:42.036982 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:57:42.039058 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:57:42.053665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:57:42.053665 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:57:42.069115 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1405/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:57:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:57:52.064611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:38.146523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:38.159599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879ca4-f86a-4ece-b85c-113751867976 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:38.165903 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:38.166541 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.166825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.167098 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.169141 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:38.183011 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:38.184635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:38.196076 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1397/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:38.205542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:38.208233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:38.282993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebbab5-1922-4d76-ab65-4564def6655f service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:38.296136 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:38.297561 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.297977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.298437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] PATH_INFO: `/v3/users/17c48aa8c35f4daea029fe634cb05c58` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.300088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c48aa8c35f4daea029fe634cb05c58)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:38.302083 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:38.358037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c48aa8c35f4daea029fe634cb05c58'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.367743 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c48aa8c35f4daea029fe634cb05c58'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.368636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c48aa8c35f4daea029fe634cb05c58'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.377538 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c48aa8c35f4daea029fe634cb05c58'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.389526 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-9df673da-19f6-4510-a192-84b8eebed472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c48aa8c35f4daea029fe634cb05c58'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.396006 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1406/2803] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:58:38 2022] DELETE /identity/v3/users/17c48aa8c35f4daea029fe634cb05c58 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:38.576400 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:38.587831 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410396d-04b2-4d81-b226-33ba0326525f service placement] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:38.649001 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:38.649807 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.650117 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.650428 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] PATH_INFO: `/v3/projects/d2374a917e334a15a2e00f603ac6b7c8` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.651736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2374a917e334a15a2e00f603ac6b7c8)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:38.653670 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:38.704396 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2374a917e334a15a2e00f603ac6b7c8', 'request_id': 'req-62c96827-b1f4-4f47-b8e9-29cedfc90136'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.712851 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2374a917e334a15a2e00f603ac6b7c8', 'request_id': 'req-62c96827-b1f4-4f47-b8e9-29cedfc90136'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.721550 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2374a917e334a15a2e00f603ac6b7c8', 'request_id': 'req-62c96827-b1f4-4f47-b8e9-29cedfc90136'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.738861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] The token cache is being invalidate because project d2374a917e334a15a2e00f603ac6b7c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:58:38.739248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.740189 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-62c96827-b1f4-4f47-b8e9-29cedfc90136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:38.745766 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1398/2804] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:58:38 2022] DELETE /identity/v3/projects/d2374a917e334a15a2e00f603ac6b7c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:38.748939 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.749477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.750032 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.780517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:38.781783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:38.852325 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1407/2805] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:38.860284 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.860572 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.860861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.884204 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:38.886145 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:38.898622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1399/2806] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:38.903596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:38.920708 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45a6aa-997e-48d3-a969-5a5a32d870c7 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:38.926990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:38.927663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.927944 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.928202 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.928937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:58:38.929240 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:38.930907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:38.944037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1408/2807] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:58:38.948691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:38.959000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed9dd9-0735-4981-992a-f6a5ad0789e6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:38.964775 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:38.965436 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:38.965719 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:38.966028 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:38.966723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:38.968641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:38.996582 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1400/2808] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:38 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:39.001142 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.012465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bbb6-2b6a-4061-871c-39da2aecdcf6 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.016556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:39.084840 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.085524 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.085809 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.086085 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.086783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.088690 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.116335 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1409/2809] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:39 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:58:39.119881 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.131395 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89bd4c-3dd8-4ad2-9e94-89105caa8509 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.137042 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25380387-455b-4466-bac9-262131372e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.137715 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25380387-455b-4466-bac9-262131372e92 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.138025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25380387-455b-4466-bac9-262131372e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.138326 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25380387-455b-4466-bac9-262131372e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.139049 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25380387-455b-4466-bac9-262131372e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.140659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25380387-455b-4466-bac9-262131372e92 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.151935 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1401/2810] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:39.156147 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.166448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c18b-9256-4ad8-b632-ee25fcf4cfc9 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.172371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.173051 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.173331 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.173605 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.174465 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.176064 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90975ea-5992-4945-ae9a-70e78c79bd7d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.186408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1410/2811] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:39.190724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25380387-455b-4466-bac9-262131372e92 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.201174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25380387-455b-4466-bac9-262131372e92 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.206409 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.207310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.207728 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.208009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] PATH_INFO: `/v3/projects/98196f26fd3f40548a27fef7247591ff/users/5a95c2db308449999a6440c31dc91f64/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.223916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98196f26fd3f40548a27fef7247591ff, user_id=5a95c2db308449999a6440c31dc91f64, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.226676 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.241827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1402/2812] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:39 2022] PUT /identity/v3/projects/98196f26fd3f40548a27fef7247591ff/users/5a95c2db308449999a6440c31dc91f64/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:39.253024 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.253551 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.253650 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.280970 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] MFA Rules not processed for user `5a95c2db308449999a6440c31dc91f64`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:39.282230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:39.352872 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1411/2813] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:39.358075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.379827 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:39.445248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96cbbf-bd99-47c9-b812-ffb14d1e9a25 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.445248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.445248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.445248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.445784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.446155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.448121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.479148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1403/2814] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:39 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:39.483400 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.495236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0522f2b-759d-4950-922a-825b135b60e9 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.563823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.564515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.564887 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.565505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.566243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.568148 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.595658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1412/2815] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:39 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 28 17:58:39.601543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.616231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088310bb-59c3-4729-84d0-47a23f0cc2e7 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.621871 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.622576 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.622897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.623180 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.623916 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.625516 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.638836 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1404/2816] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:39.644649 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.651707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:39.655823 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85794bc8-04f1-4b8e-b9c7-d76bb46248df admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.662469 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.663371 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.663653 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.663926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] PATH_INFO: `/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14/users/bf7be601fab7436b8480a8845541238f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.679916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa880f0bd26490c8d78cb376ea3fd14, user_id=bf7be601fab7436b8480a8845541238f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.682609 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.697867 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1413/2817] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:39 2022] PUT /identity/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14/users/bf7be601fab7436b8480a8845541238f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:39.702342 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.713959 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2787b7-14fc-4480-a309-9d87bb28aa31 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.777526 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.778248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.778527 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.778819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.779538 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.781147 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379b2bf-e3be-4b06-abfc-9dfc3fb5a449 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.791858 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1405/2818] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:39.796126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.807453 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e6158-8bc7-4171-ba51-e8e81d11b88a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:39.813287 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:39.814234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.814515 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.814794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] PATH_INFO: `/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14/users/bf7be601fab7436b8480a8845541238f/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.816981 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa880f0bd26490c8d78cb376ea3fd14, user_id=bf7be601fab7436b8480a8845541238f, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:39.819663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:39.832187 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1414/2819] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:39 2022] PUT /identity/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14/users/bf7be601fab7436b8480a8845541238f/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:39.842329 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:39.842620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:39.842917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:39.872542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] MFA Rules not processed for user `bf7be601fab7436b8480a8845541238f`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:39.873779 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:39.956410 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1406/2820] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:39.970485 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:39.972697 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:40.034264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8abd78-6b16-43fe-8ce6-a3ac2894ef99 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:40.037978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:40.038657 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:40.038934 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:40.039203 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:40.049233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:40.050932 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:40.060824 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1415/2821] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:40.144121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:40.157323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd55f1-17b7-448e-b825-c0cf9b812027 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:40.161641 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:40.162362 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:40.162690 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:40.162967 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:40.168968 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:40.226870 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:40.228260 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50ddd0-6856-48fc-a277-5cbbc56df304 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:40.238142 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1407/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:43.042509 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:43.109348 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c085-07d8-4359-9032-50bf5d822394 service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:43.114770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:43.115655 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:43.115935 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:43.116213 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] PATH_INFO: `/v3/users/5a95c2db308449999a6440c31dc91f64` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:43.117392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a95c2db308449999a6440c31dc91f64)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:43.119350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:43.171206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a95c2db308449999a6440c31dc91f64'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.179758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a95c2db308449999a6440c31dc91f64'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.180451 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a95c2db308449999a6440c31dc91f64'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.189368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a95c2db308449999a6440c31dc91f64'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.197858 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:43.204020 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a95c2db308449999a6440c31dc91f64'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.211611 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1416/2823] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:58:43 2022] DELETE /identity/v3/users/5a95c2db308449999a6440c31dc91f64 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:43.216174 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:43.216673 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:43.216769 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:43.234793 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:43.235999 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:43.299814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1408/2824] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:43.309625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:43.311157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:43.369252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150267e-ccaa-4344-b6fb-55beaca19102 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:43.373040 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:43.373686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:43.373967 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:43.374263 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:43.383554 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:43.384984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:43.395194 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1417/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:58:43.693347 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:43.694886 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:43.707048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b27f99-e393-42db-b073-a3b8d4caa015 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:43.712853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:43.713760 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:43.714139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:43.714423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] PATH_INFO: `/v3/projects/98196f26fd3f40548a27fef7247591ff` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:43.715747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98196f26fd3f40548a27fef7247591ff)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:43.717736 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:43.774854 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98196f26fd3f40548a27fef7247591ff', 'request_id': 'req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.780595 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98196f26fd3f40548a27fef7247591ff', 'request_id': 'req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.787989 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98196f26fd3f40548a27fef7247591ff', 'request_id': 'req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.803422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] The token cache is being invalidate because project 98196f26fd3f40548a27fef7247591ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:58:43.803655 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.804323 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.805980 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1409/2826] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:58:43 2022] DELETE /identity/v3/projects/98196f26fd3f40548a27fef7247591ff => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:43.810074 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:43.820233 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798108c-cec2-4b79-ac67-38c0c701483c service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:43.881372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:43.882297 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:43.882571 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:43.882846 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] PATH_INFO: `/v3/users/bf7be601fab7436b8480a8845541238f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:43.884007 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7be601fab7436b8480a8845541238f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:43.885904 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:43.937281 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7be601fab7436b8480a8845541238f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.944021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7be601fab7436b8480a8845541238f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.944822 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7be601fab7436b8480a8845541238f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.954088 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7be601fab7436b8480a8845541238f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.966274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-258bfbd6-9db3-4baf-ba08-d939ac73671d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7be601fab7436b8480a8845541238f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:43.972301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1418/2827] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:58:43 2022] DELETE /identity/v3/users/bf7be601fab7436b8480a8845541238f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:44.267739 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.269224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:44.283894 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd21e4-8cf8-42e8-8b80-5a8506ee6296 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.317553 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:44.348680 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.349544 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.349825 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.350241 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] PATH_INFO: `/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.351472 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa880f0bd26490c8d78cb376ea3fd14)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.353467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.406668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa880f0bd26490c8d78cb376ea3fd14', 'request_id': 'req-7a619247-77af-480b-8c77-81e6edbdb6f7'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:44.413231 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa880f0bd26490c8d78cb376ea3fd14', 'request_id': 'req-7a619247-77af-480b-8c77-81e6edbdb6f7'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:44.419653 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa880f0bd26490c8d78cb376ea3fd14', 'request_id': 'req-7a619247-77af-480b-8c77-81e6edbdb6f7'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:44.433678 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] The token cache is being invalidate because project 0aa880f0bd26490c8d78cb376ea3fd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:58:44.434002 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:44.434627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-7a619247-77af-480b-8c77-81e6edbdb6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:44.436213 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1410/2828] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:58:44 2022] DELETE /identity/v3/projects/0aa880f0bd26490c8d78cb376ea3fd14 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:44.441231 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.441716 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.441811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.461422 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:44.462686 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:44.468957 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:44.529112 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1419/2829] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:44.541706 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.542158 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.542585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.565924 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:44.567175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:44.576535 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1411/2830] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:44.581104 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.591543 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381c5b6-96cb-4a11-86a9-1c0ed1ee9e12 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.597122 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.597794 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.598093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.598372 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.599159 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:58:44.599408 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.601025 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.613478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1420/2831] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:58:44.618176 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.627862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf4916-d02a-4216-aa92-e2a63b66b281 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.633422 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.634121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.634549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.634668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.635368 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.637317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.670386 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1412/2832] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:44 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:44.674907 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.685676 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bacf59-ff35-46f6-8a4f-06192ad2015b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.745138 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.745860 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.746189 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.746456 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.747246 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.749162 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.774154 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1421/2833] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:44 2022] POST /identity/v3/users => generated 305 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:44.779058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.791725 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebe115-33a3-4a61-8393-39e48e3f74c1 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.796996 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.797705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.798025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.798306 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.799075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.800687 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.813120 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1413/2834] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:44.817757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.829047 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2c58e-dd99-47d5-be07-9e8fd49588e5 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.835016 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.835710 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.835995 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.836267 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.836990 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.838654 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c6748-6bd6-4128-bfd6-bd458d061266 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.849668 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1422/2835] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:44.854288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:44.868693 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7baef-aa87-4d73-b9ac-7a4dd8a59558 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:44.875929 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:44.876983 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.877266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.877587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] PATH_INFO: `/v3/projects/1bc2563e1c524c7c8d4738c132e87d7c/users/208533def5c448149dc248d5b904bc2f/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.894799 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc2563e1c524c7c8d4738c132e87d7c, user_id=208533def5c448149dc248d5b904bc2f, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:44.898000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:44.911759 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1414/2836] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:44 2022] PUT /identity/v3/projects/1bc2563e1c524c7c8d4738c132e87d7c/users/208533def5c448149dc248d5b904bc2f/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:58:44.923350 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:44.923642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:44.923923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:44.952541 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] MFA Rules not processed for user `208533def5c448149dc248d5b904bc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:44.953765 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:45.031582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1423/2837] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:45.036819 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.105984 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:45.109684 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4477c-7f4e-4b9a-88bb-4850fb927d70 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.115978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.116783 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.117077 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.117378 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.118285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.120664 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.148304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1415/2838] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:45 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:45.152481 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.163486 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ccb6-05c8-4cce-b244-0ef269110cb1 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.167120 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:45.224082 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.224804 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.225078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.225353 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.226056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.227993 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.250905 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1424/2839] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:45 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:45.254990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.266110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16478ed6-a898-4224-8c6d-74460f95ecca admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.271522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.272308 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.272594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.272867 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.273591 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.275232 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.286845 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1416/2840] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:45.291177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.301494 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b807-ccc1-4e9f-9540-77e881a781fd admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.307943 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.308841 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.309118 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.309414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] PATH_INFO: `/v3/projects/d6acb267465f4aefbfaf9e58971f9900/users/1ec17273e4014130b2cae3f4903e19fa/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.325316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6acb267465f4aefbfaf9e58971f9900, user_id=1ec17273e4014130b2cae3f4903e19fa, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.328010 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.343937 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1425/2841] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:45 2022] PUT /identity/v3/projects/d6acb267465f4aefbfaf9e58971f9900/users/1ec17273e4014130b2cae3f4903e19fa/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 28 17:58:45.348053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.358724 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084a21-9ca4-4ef6-b58b-fd80597ae2cc admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.418531 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.419253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.419532 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.419802 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.420522 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.422137 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a0c3-3f4c-4595-841f-fe95833d69af admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.432554 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1417/2842] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:45.437206 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.452368 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9704369-6f65-4d48-9dc7-f126382916e8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.457330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.458758 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.459035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.459316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] PATH_INFO: `/v3/projects/d6acb267465f4aefbfaf9e58971f9900/users/1ec17273e4014130b2cae3f4903e19fa/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.461412 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6acb267465f4aefbfaf9e58971f9900, user_id=1ec17273e4014130b2cae3f4903e19fa, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.464127 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.475882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1426/2843] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:45 2022] PUT /identity/v3/projects/d6acb267465f4aefbfaf9e58971f9900/users/1ec17273e4014130b2cae3f4903e19fa/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:45.491694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.492048 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.492446 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.526050 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] MFA Rules not processed for user `1ec17273e4014130b2cae3f4903e19fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:45.527283 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:45.599185 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1418/2844] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:45.610933 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.612751 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:45.683049 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2cad9-f57a-40d4-a2ff-cd613360a660 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.689892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.690862 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.691298 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.691574 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.704161 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.705606 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.715946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1427/2845] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:45.878492 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:45.889602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd9162-bb84-40f6-ad30-6fb431880c44 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:45.893493 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:45.894182 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:45.894470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:45.894747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:45.946863 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:45.958227 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:45.959834 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12712849-984b-4f28-811e-7d2323df4a80 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:45.969094 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1419/2846] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:45 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:51.345684 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:51.415018 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc710a3-1105-4784-9143-dd200f9fbaec service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:51.420392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:51.421302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:51.421503 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:51.421774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] PATH_INFO: `/v3/users/208533def5c448149dc248d5b904bc2f` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:51.423196 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208533def5c448149dc248d5b904bc2f)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:51.425117 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:51.427950 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:51.490183 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208533def5c448149dc248d5b904bc2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:51.501546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208533def5c448149dc248d5b904bc2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:51.502502 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208533def5c448149dc248d5b904bc2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:51.513305 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208533def5c448149dc248d5b904bc2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:51.525702 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208533def5c448149dc248d5b904bc2f'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:51.533026 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1428/2847] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:58:51 2022] DELETE /identity/v3/users/208533def5c448149dc248d5b904bc2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:51.540101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:51.540594 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:51.540694 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:51.559708 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:51.560921 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:51.626171 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1420/2848] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:51.636252 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:51.637923 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:51.709066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cb34b-8fda-4a0c-b2a0-f246fd0b59d8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:51.715843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:51.716847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:51.717125 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:51.717394 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:51.728035 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:51.729479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:51.740039 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1429/2849] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:52.023010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:52.024589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:52.037220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d1644-6d39-4e9e-85d8-2595aa5968c2 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:52.042784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:52.043723 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.044000 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.044261 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] PATH_INFO: `/v3/projects/1bc2563e1c524c7c8d4738c132e87d7c` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.045524 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc2563e1c524c7c8d4738c132e87d7c)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:52.047490 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:52.097504 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc2563e1c524c7c8d4738c132e87d7c', 'request_id': 'req-8deb0259-573a-448e-a2fb-ce12bf03d658'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.102811 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc2563e1c524c7c8d4738c132e87d7c', 'request_id': 'req-8deb0259-573a-448e-a2fb-ce12bf03d658'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.109009 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc2563e1c524c7c8d4738c132e87d7c', 'request_id': 'req-8deb0259-573a-448e-a2fb-ce12bf03d658'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.123246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] The token cache is being invalidate because project 1bc2563e1c524c7c8d4738c132e87d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:58:52.123540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.124314 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.126122 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1421/2850] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:58:52 2022] DELETE /identity/v3/projects/1bc2563e1c524c7c8d4738c132e87d7c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:52.130440 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:52.140843 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ee8b-80d4-4c17-a94f-65604249489e service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:52.200878 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:52.201802 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.202097 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.202376 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] PATH_INFO: `/v3/users/1ec17273e4014130b2cae3f4903e19fa` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.203658 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec17273e4014130b2cae3f4903e19fa)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:52.205565 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:52.243620 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:52.268916 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec17273e4014130b2cae3f4903e19fa'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.277512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec17273e4014130b2cae3f4903e19fa'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.278375 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec17273e4014130b2cae3f4903e19fa'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.287316 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec17273e4014130b2cae3f4903e19fa'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.300130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-a25be336-c3cc-4ddc-bfd2-14bdbdceb035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec17273e4014130b2cae3f4903e19fa'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.306366 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1430/2851] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:58:52 2022] DELETE /identity/v3/users/1ec17273e4014130b2cae3f4903e19fa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:52.610517 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:52.612148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:52.625832 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0259-573a-448e-a2fb-ce12bf03d658 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:52.689371 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:52.690298 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.690569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.690841 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] PATH_INFO: `/v3/projects/d6acb267465f4aefbfaf9e58971f9900` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.692027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6acb267465f4aefbfaf9e58971f9900)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:52.693985 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:52.711877 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:52.752114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6acb267465f4aefbfaf9e58971f9900', 'request_id': 'req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.757467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6acb267465f4aefbfaf9e58971f9900', 'request_id': 'req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.765379 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6acb267465f4aefbfaf9e58971f9900', 'request_id': 'req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.787571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] The token cache is being invalidate because project d6acb267465f4aefbfaf9e58971f9900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:58:52.787865 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.788565 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-f394bdd5-5ca3-4efc-a70f-ec7ba010db4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:58:52.790302 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1422/2852] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:58:52 2022] DELETE /identity/v3/projects/d6acb267465f4aefbfaf9e58971f9900 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:52.796030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.796603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.796603 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.817099 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:52.818354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:52.880853 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1431/2853] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:52.890432 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.890721 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.891044 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.912072 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:52.913291 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:52.922015 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1423/2854] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:52.926340 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:52.936544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9966da8-143a-4463-81ff-83a42ab42583 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:52.941586 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:52.942280 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.942555 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.942828 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.943550 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:58:52.943842 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:52.945436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:52.958274 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1432/2855] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:58:52.962683 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:52.972148 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32756561-d0ba-4f26-8216-121352b65fd9 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:52.976957 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:52.977615 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:52.977887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:52.978193 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:52.978887 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:52.980777 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.012032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1424/2856] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:52 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:53.016410 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.027157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c29b80-1073-48a8-bce1-44925bdf3785 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.099972 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.100926 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.101302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.101542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.102619 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.105461 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.128437 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1433/2857] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:53 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:53.133822 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.145027 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ba670-2a65-4f67-bc85-5586b35cc435 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.150623 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.151301 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.151585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.151860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.152589 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.154254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.165756 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1425/2858] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:53.170260 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.181416 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b933-690e-4e0b-83a0-3440318504bb admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.186984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.187656 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.187940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.188218 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.188948 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.190592 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afbe14-7408-46d3-89e9-29616ef08cea admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.201599 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1434/2859] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:53.206006 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.217674 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c0d3-b345-4e2d-a032-792dde01688d admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.223274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.224172 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.224451 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.224726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] PATH_INFO: `/v3/projects/857ded2eb0744008ada664c64d7ff85e/users/ee6ef3eebc66493a8143444af5b38235/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.241599 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857ded2eb0744008ada664c64d7ff85e, user_id=ee6ef3eebc66493a8143444af5b38235, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.244287 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.259926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1426/2860] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:53 2022] PUT /identity/v3/projects/857ded2eb0744008ada664c64d7ff85e/users/ee6ef3eebc66493a8143444af5b38235/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:53.271517 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.271810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.272092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.291847 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:53.306581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] MFA Rules not processed for user `ee6ef3eebc66493a8143444af5b38235`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:53.308836 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:53.375355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1435/2861] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:58:53.380246 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.444253 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a53ab-7923-4249-9344-385a14e79a21 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.449230 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.449895 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.450188 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.450556 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.451583 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.453488 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.485512 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1427/2862] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:53.490436 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.504460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f347c-1013-436a-abec-4e7a35a0326f None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.566463 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.567053 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.567330 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.567598 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.568286 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.570241 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.592735 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1436/2863] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:58:53 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:58:53.597285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.611562 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927fbe83-36b9-4691-9ecb-e824a4daf599 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.617288 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.617992 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.618309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.618621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.619357 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.620973 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.633403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1428/2864] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 28 17:58:53.637834 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.649014 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7d83e-dbd3-48e9-8170-fe51daf76e5f admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.655178 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.656078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.656358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.656631 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] PATH_INFO: `/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb/users/8ec15fa516f3411ab1b76b90369f3f77/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.676762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c2d5d3496f41dca926ee77e84ca5eb, user_id=8ec15fa516f3411ab1b76b90369f3f77, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.679460 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.694703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1437/2865] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:53 2022] PUT /identity/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb/users/8ec15fa516f3411ab1b76b90369f3f77/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:53.698910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.709713 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0dc9-28a3-4435-9ac3-87c576808c97 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.724910 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:53.775633 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.776350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.776627 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.776900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.777630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.780135 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060b15a-0a56-4eaa-9b8a-2b4d20418fc0 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.790817 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1429/2866] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:58:53.795971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.812289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b57d5-09e1-4201-ba85-88a66edc4a7b admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:53.821532 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:53.822838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.823282 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.823582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] PATH_INFO: `/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb/users/8ec15fa516f3411ab1b76b90369f3f77/roles/dd1ee2044a264c889a54729a0b3f69ea` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.826687 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c2d5d3496f41dca926ee77e84ca5eb, user_id=8ec15fa516f3411ab1b76b90369f3f77, role_id=dd1ee2044a264c889a54729a0b3f69ea)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:53.829347 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:53.842101 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1438/2867] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:58:53 2022] PUT /identity/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb/users/8ec15fa516f3411ab1b76b90369f3f77/roles/dd1ee2044a264c889a54729a0b3f69ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:58:53.853622 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:53.853962 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:53.854333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:53.883770 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] MFA Rules not processed for user `8ec15fa516f3411ab1b76b90369f3f77`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:58:53.885012 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:53.960320 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1430/2868] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:58:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:58:53.972332 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:53.974269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:54.036567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb23c51-989c-4689-9847-579dadb7ba0d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:54.040636 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:54.041275 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:54.041566 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:54.041838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:54.047567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:58:54.109512 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:54.111510 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:54.124626 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1439/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:58:58.424243 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:58:58.425990 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:58:58.473960 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d90c-8dad-45d6-9e56-9f03a1e517b0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:58:58.478168 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:58:58.478814 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:58:58.479080 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:58:58.479359 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:58:58.511175 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:58:58.512620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615628d-224c-409f-b3c0-7ea5164230d6 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:58:58.523294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1431/2870] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:58:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:03.481130 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:03.588114 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b04ba-92cf-4ac2-8caf-43be1345c3bc service cinder] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:03.594021 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:03.594879 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:03.595158 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:03.595432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] PATH_INFO: `/v3/users/ee6ef3eebc66493a8143444af5b38235` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:03.596768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6ef3eebc66493a8143444af5b38235)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:03.598783 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:03.650850 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6ef3eebc66493a8143444af5b38235'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:03.658952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6ef3eebc66493a8143444af5b38235'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:03.659740 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6ef3eebc66493a8143444af5b38235'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:03.669663 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6ef3eebc66493a8143444af5b38235'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:03.677581 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:03.683567 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6ef3eebc66493a8143444af5b38235'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:03.690601 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1440/2871] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:59:03 2022] DELETE /identity/v3/users/ee6ef3eebc66493a8143444af5b38235 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:03.695474 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:03.695972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:03.696083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:03.739519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:03.740506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:03.754063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=100 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:03.809714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1432/2872] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:03.821199 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:03.822852 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:03.915328 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490faf-0c71-4082-9d7d-03f991b71b2d admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:03.919698 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:03.920358 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:03.920642 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:03.920947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:03.933238 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:03.935975 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:03.952971 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1441/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:04.267659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:04.269194 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:04.283932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026b5d9-877e-4340-9948-c27dbdcac1fe None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:04.289792 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:04.290897 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:04.291637 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:04.292150 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] PATH_INFO: `/v3/projects/857ded2eb0744008ada664c64d7ff85e` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:04.293542 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=857ded2eb0744008ada664c64d7ff85e)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:04.295549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:04.352958 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857ded2eb0744008ada664c64d7ff85e', 'request_id': 'req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.360414 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857ded2eb0744008ada664c64d7ff85e', 'request_id': 'req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.370338 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857ded2eb0744008ada664c64d7ff85e', 'request_id': 'req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.385901 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] The token cache is being invalidate because project 857ded2eb0744008ada664c64d7ff85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:59:04.386250 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.386951 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.388620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1433/2874] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:59:04 2022] DELETE /identity/v3/projects/857ded2eb0744008ada664c64d7ff85e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:04.392747 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:04.402927 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9bc36-1bc4-4b79-98f1-04cfa2b3efe2 service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:04.462236 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:04.463157 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:04.463432 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:04.463706 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] PATH_INFO: `/v3/users/8ec15fa516f3411ab1b76b90369f3f77` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:04.464956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec15fa516f3411ab1b76b90369f3f77)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:04.466892 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:04.516793 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec15fa516f3411ab1b76b90369f3f77'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.523969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec15fa516f3411ab1b76b90369f3f77'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.524627 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec15fa516f3411ab1b76b90369f3f77'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.533838 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec15fa516f3411ab1b76b90369f3f77'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.542037 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:04.547093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-fff514ea-8095-4d6a-85eb-06efabd4ca6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec15fa516f3411ab1b76b90369f3f77'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:04.554072 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1442/2875] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:59:04 2022] DELETE /identity/v3/users/8ec15fa516f3411ab1b76b90369f3f77 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:04.853843 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:04.855423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:04.870558 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8db3b-7572-4e40-862a-a7fd6e84ecbd admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:04.932170 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:04.932954 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:04.933233 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:04.933506 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] PATH_INFO: `/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:04.934714 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c2d5d3496f41dca926ee77e84ca5eb)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:04.936720 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:04.986702 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:04.991659 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c2d5d3496f41dca926ee77e84ca5eb', 'request_id': 'req-70189a3d-24cb-48e2-a422-d3c229c39e58'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:05.000059 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c2d5d3496f41dca926ee77e84ca5eb', 'request_id': 'req-70189a3d-24cb-48e2-a422-d3c229c39e58'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:05.007398 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c2d5d3496f41dca926ee77e84ca5eb', 'request_id': 'req-70189a3d-24cb-48e2-a422-d3c229c39e58'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:05.022600 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] The token cache is being invalidate because project 52c2d5d3496f41dca926ee77e84ca5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:59:05.022892 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:05.023579 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-70189a3d-24cb-48e2-a422-d3c229c39e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:05.025132 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1434/2876] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:59:04 2022] DELETE /identity/v3/projects/52c2d5d3496f41dca926ee77e84ca5eb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:05.031477 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.031774 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.032066 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.072924 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:05.074204 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:05.139810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1443/2877] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:59:05.150317 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.150604 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.150928 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.171066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:05.172336 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:05.181083 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1435/2878] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:05.186003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.197866 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fc82e-2fdb-4cb3-baf9-9dfe2a0c55c6 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.203247 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.204424 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.204705 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.205078 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.205848 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:59:05.206917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.209363 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.221625 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1444/2879] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:59:05.226601 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.236215 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc56f6-abb1-448b-ab76-2f01bbfd8dd7 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.241330 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.242025 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.242309 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.242585 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.243310 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.245220 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.273994 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1436/2880] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:59:05 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:59:05.278770 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.290938 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf421e-3e45-4869-bdda-bebfff596564 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.353582 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.354302 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.354591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.354873 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.355596 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.357533 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.382810 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1445/2881] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:59:05 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:59:05.387470 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.400869 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008263a-c36f-47c6-b978-183d99eccae2 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.406691 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.407469 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.407774 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.408069 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.408800 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.410483 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.422197 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1437/2882] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:59:05.426450 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.437478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d912f1-83b3-465e-b669-b994b586ea59 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.443273 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.443946 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.444224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.444495 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.445200 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.446882 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5384679-927d-466d-aa29-2abc2548b9eb admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.458163 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1446/2883] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:59:05.461917 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.473086 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e55aa-6a92-416e-a462-e0daad672186 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.479350 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.480294 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.480547 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.480853 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] PATH_INFO: `/v3/projects/e1950e76a9af4e3aaeda79d56e8288eb/users/e49748ca9da440e6983c4fa24d795f07/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.498085 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1950e76a9af4e3aaeda79d56e8288eb, user_id=e49748ca9da440e6983c4fa24d795f07, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.500782 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.520704 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1438/2884] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:59:05 2022] PUT /identity/v3/projects/e1950e76a9af4e3aaeda79d56e8288eb/users/e49748ca9da440e6983c4fa24d795f07/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:05.534767 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.535354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.535354 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.565906 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] MFA Rules not processed for user `e49748ca9da440e6983c4fa24d795f07`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:05.567230 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:05.607397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:05.649513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1447/2885] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:05.662926 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:05.664846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:05.728445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6271-ca7c-47a4-8ba9-142db98c991f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:05.732039 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d734accab24459a8a6848029c1f6315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:05.732696 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:05.732978 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:05.733254 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:05.741573 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:05.743063 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5f66a-d6d3-4bd9-91a8-c5448a0cca4f service glance] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:05.751790 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1439/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:15.646364 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=13 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:15.748040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=61,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:21.561750 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:21.635164 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de03f85-375d-4d47-badb-fec0aaaeeb05 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:21.640467 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:21.641355 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:21.641637 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:21.641912 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] PATH_INFO: `/v3/users/e49748ca9da440e6983c4fa24d795f07` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:21.643190 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49748ca9da440e6983c4fa24d795f07)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:21.645500 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:21.708703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49748ca9da440e6983c4fa24d795f07'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:21.719392 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49748ca9da440e6983c4fa24d795f07'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:21.720265 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49748ca9da440e6983c4fa24d795f07'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:21.729197 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49748ca9da440e6983c4fa24d795f07'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:21.748969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49748ca9da440e6983c4fa24d795f07'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:21.755806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1448/2887] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:59:21 2022] DELETE /identity/v3/users/e49748ca9da440e6983c4fa24d795f07 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:21.761211 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:21.761747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:21.761747 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:21.781590 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:21.782850 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:21.850340 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1440/2888] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:21.860839 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:21.862919 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:21.928940 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d446627-6f0d-40aa-aff7-be60178fe3d8 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:21.934015 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:21.934679 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:21.934956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:21.935232 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:21.949176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:21.950660 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09dd2-1c34-45ed-a04c-a29f826a55c2 service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:21.961185 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1449/2889] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:22.250126 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.251964 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:22.265109 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776de846-c07d-4c70-93d9-21dc4a2de1c0 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.271114 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.272155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.272511 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.272860 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] PATH_INFO: `/v3/projects/e1950e76a9af4e3aaeda79d56e8288eb` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.274248 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1950e76a9af4e3aaeda79d56e8288eb)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.276281 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.328495 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1950e76a9af4e3aaeda79d56e8288eb', 'request_id': 'req-785a5335-ec5b-4e46-b20d-59ba2db79c22'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:22.334972 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1950e76a9af4e3aaeda79d56e8288eb', 'request_id': 'req-785a5335-ec5b-4e46-b20d-59ba2db79c22'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:22.341344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1950e76a9af4e3aaeda79d56e8288eb', 'request_id': 'req-785a5335-ec5b-4e46-b20d-59ba2db79c22'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:22.359737 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] The token cache is being invalidate because project e1950e76a9af4e3aaeda79d56e8288eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:59:22.360100 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:22.360900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-785a5335-ec5b-4e46-b20d-59ba2db79c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:22.362602 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1441/2890] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:59:22 2022] DELETE /identity/v3/projects/e1950e76a9af4e3aaeda79d56e8288eb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:22.369728 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.370141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.370505 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.412446 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:22.413712 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:22.424168 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:22.481237 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1450/2891] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:22.491654 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.491942 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.492225 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.513403 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:22.514726 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:22.523757 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1442/2892] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:22.528449 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.539947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d802d-bdfd-4c21-a6d8-887e75162da2 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.546166 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.546900 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.547177 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.547448 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] PATH_INFO: `/v3/domains` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.548193 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 28 17:59:22.548501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.550245 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.564248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1451/2893] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Jun 28 17:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 28 17:59:22.568987 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.579620 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd7d21-4776-4766-acc9-e5b0d47ac1c6 None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.584932 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.585795 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.586127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.586407 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.587121 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.589101 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.620519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1443/2894] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Jun 28 17:59:22 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:59:22.626513 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.637985 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8c8dc-522f-453a-bb4e-90d48f94a81a admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.706250 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.706947 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.707234 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.707504 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] PATH_INFO: `/v3/users` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.708264 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.710176 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.732707 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1452/2895] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Jun 28 17:59:22 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 28 17:59:22.737669 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.749442 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad645031-e295-4767-938a-73de2f5ff3f5 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.754569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.755263 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.755543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.755816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.756575 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.758266 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.771053 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1444/2896] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:59:22.776102 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.787397 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9314c7a-92f6-439f-9308-0ee8f1f8be04 admin admin] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.792591 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.793244 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.793527 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.793806 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] PATH_INFO: `/v3/roles` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.794616 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.796535 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e3571-d39b-4f71-a2fc-f3e37570e915 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.808414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1453/2897] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Jun 28 17:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 28 17:59:22.813274 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:22.828741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4e3e-8c3c-4fe5-a6af-4ec899904dfe admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:22.836304 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:22.837884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] REQUEST_METHOD: `PUT` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.838408 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.838882 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] PATH_INFO: `/v3/projects/a4c5ac99a46f4a9895a94fa71dfb6c72/users/f8a634a3967d40e485750e85bc984405/roles/92f222645a174bcab24981d46e9900f9` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.861019 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4c5ac99a46f4a9895a94fa71dfb6c72, user_id=f8a634a3967d40e485750e85bc984405, role_id=92f222645a174bcab24981d46e9900f9)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:22.863884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:22.880668 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1445/2898] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Jun 28 17:59:22 2022] PUT /identity/v3/projects/a4c5ac99a46f4a9895a94fa71dfb6c72/users/f8a634a3967d40e485750e85bc984405/roles/92f222645a174bcab24981d46e9900f9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:22.947214 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad57bcd-0c47-465e-b334-0e7a047a3faf None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:22.947501 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad57bcd-0c47-465e-b334-0e7a047a3faf None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:22.947782 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad57bcd-0c47-465e-b334-0e7a047a3faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:22.977478 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-1ad57bcd-0c47-465e-b334-0e7a047a3faf None None] MFA Rules not processed for user `f8a634a3967d40e485750e85bc984405`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:22.978769 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-1ad57bcd-0c47-465e-b334-0e7a047a3faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:23.050116 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1454/2899] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:23.061846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:23.064110 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:23.090519 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:23.131730 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c8dbd-8a21-4253-b88c-8a17964ed641 admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:23.135477 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fabfc6086e244db994a4bbbbbdfc5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:23.136139 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:23.136431 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:23.136705 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:23.147334 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:23.148808 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:23.159749 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1446/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:24.560243 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:24.560917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:24.560917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:24.582367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] MFA Rules not processed for user `f8a634a3967d40e485750e85bc984405`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:24.583762 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:24.592046 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1455/2901] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:25.109058 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:25.111305 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:25.202847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcfe1-c4e8-4847-a3b0-1130bac831a1 service cinder] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:25.209840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:25.210635 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:25.210900 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:25.211177 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:25.213473 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:25.227540 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:25.229195 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:25.240780 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1447/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:27.353269 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:27.355056 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:27.360414 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:27.440729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae87f73-2bb8-4ea6-8a17-fcd9b70ee546 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:27.444984 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:27.446012 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:27.446452 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:27.446725 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:27.448638 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:27.470075 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:27.471534 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:27.487479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1456/2903] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:28.199981 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:28.201464 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:28.298741 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ce9d-056a-44e2-9cfb-3cf43fed90b5 service placement] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:28.304383 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:28.305107 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:28.305346 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:28.305632 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:28.307445 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:28.321846 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:28.323515 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bcb17-8657-4ded-a6ba-6838abf88557 service nova] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:28.335925 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1448/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:32.653011 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:32.655070 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:32.674324 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c3008-c0ef-4afd-bd65-7eeae1c9e30b service neutron] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:32.680757 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef1eedbaa7574783adde2884c2b9a482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:32.681573 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:32.681977 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:32.682428 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:32.684479 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:32.699835 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:32.701439 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:32.713499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1457/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 28 17:59:38.331066 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=86 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:38.527192 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98faa3-1670-4de6-a92f-f5f7390ec99c None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:38.527476 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98faa3-1670-4de6-a92f-f5f7390ec99c None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:38.527784 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98faa3-1670-4de6-a92f-f5f7390ec99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:38.558847 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-8f98faa3-1670-4de6-a92f-f5f7390ec99c None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:38.560127 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-8f98faa3-1670-4de6-a92f-f5f7390ec99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:38.625467 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1449/2906] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:59:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:38.686454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:38.688103 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:38.771211 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc4c2-960e-456d-868a-69d76d84ee32 service nova] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:38.779301 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:38.780755 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:38.781029 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:38.781289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:38.791580 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:38.793222 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:38.803242 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1458/2907] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:59:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:39.362268 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30381c0-c229-4e2b-ba16-c89f45c7c877 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:39.362816 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30381c0-c229-4e2b-ba16-c89f45c7c877 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:39.362934 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30381c0-c229-4e2b-ba16-c89f45c7c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:39.393417 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-b30381c0-c229-4e2b-ba16-c89f45c7c877 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:39.396004 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-b30381c0-c229-4e2b-ba16-c89f45c7c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:39.405549 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1450/2908] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:59:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:39.418754 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:39.431149 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a550-df58-4163-aacf-821c0fd4db24 service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:39.436956 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:39.437768 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:39.438093 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:39.438367 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:39.452393 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:39.454055 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:39.463730 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1459/2909] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:39.686791 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977e35-f365-47c2-a5af-6a9c4f5a55f2 None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:39.687040 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977e35-f365-47c2-a5af-6a9c4f5a55f2 None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:39.687344 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54977e35-f365-47c2-a5af-6a9c4f5a55f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:39.708133 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-54977e35-f365-47c2-a5af-6a9c4f5a55f2 None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:39.709361 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-54977e35-f365-47c2-a5af-6a9c4f5a55f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:39.722918 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1451/2910] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Jun 28 17:59:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 28 17:59:39.735143 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:39.746542 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513febb-7714-4d64-9c13-ef958b66c243 service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:39.752092 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:39.752763 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:39.753030 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:39.753304 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:39.763969 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:39.765703 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:39.775811 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1460/2911] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:59:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:40.145651 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] REQUEST_METHOD: `POST` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:40.145966 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:40.146376 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:40.165976 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.auth.core [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] MFA Rules not processed for user `25c81a07126a425e9f4b7abfccaddab9`. Rule list: `[]` (Enabled: `True`). {{(pid=86679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:40.167238 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:40.175771 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1452/2912] 10.222.0.48 () {58 vars in 967 bytes} [Tue Jun 28 17:59:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:40.188729 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:40.200544 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c985f02-dbfb-4166-b951-be9fe454495b service swift] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:40.205917 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc6c5d2d92294b1396bd6ca40db346bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:40.206644 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] REQUEST_METHOD: `GET` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:40.206952 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:40.207224 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:40.216321 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:40.217913 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3f410-61d4-4497-ad3c-7649e4dfe735 service swift] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:40.227248 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1461/2913] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Jun 28 17:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 28 17:59:42.418621 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:42.508828 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81463f47-1104-4895-8464-76a40c0e4f3f None None] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:42.516630 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:42.517569 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:42.517861 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:42.518183 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] PATH_INFO: `/v3/users/f8a634a3967d40e485750e85bc984405` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:42.520032 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a634a3967d40e485750e85bc984405)` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:42.522523 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:42.578251 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a634a3967d40e485750e85bc984405'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:42.578939 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a634a3967d40e485750e85bc984405'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:42.579543 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a634a3967d40e485750e85bc984405'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:42.588491 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a634a3967d40e485750e85bc984405'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:42.597675 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.notifications [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a634a3967d40e485750e85bc984405'} {{(pid=86679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:42.612880 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:42.627884 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1453/2914] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Jun 28 17:59:42 2022] DELETE /identity/v3/users/f8a634a3967d40e485750e85bc984405 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:42.632717 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] REQUEST_METHOD: `POST` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:42.633672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:42.633672 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:42.652701 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.auth.core [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] MFA Rules not processed for user `43de8f9a9dd148ed949cb5d02a060097`. Rule list: `[]` (Enabled: `True`). {{(pid=86680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 28 17:59:42.653897 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:42.698404 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=100 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:42.722419 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1462/2915] 10.222.0.48 () {58 vars in 957 bytes} [Tue Jun 28 17:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 28 17:59:42.733271 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:42.734862 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:42.809955 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7ff7b-3450-4dfe-8044-71c2abb80e9f admin admin] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:42.814224 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51413215fe6d42f7a76a6764c2a993cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:42.815010 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:42.815333 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:42.815701 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:42.832162 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:42.833735 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:42.845666 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1454/2916] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 17:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 17:59:43.049126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] Authenticating user token {{(pid=86680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 17:59:43.050791 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.fernet_utils [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 17:59:43.064583 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97186c-f0ed-4ce1-b16b-5c00d0648812 None None] Validating token access rules against request {{(pid=86680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 17:59:43.069546 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43de8f9a9dd148ed949cb5d02a060097', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd23346f45c341b78a895818770ee4ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 17:59:43.070556 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 17:59:43.070821 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 17:59:43.071126 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] PATH_INFO: `/v3/projects/a4c5ac99a46f4a9895a94fa71dfb6c72` {{(pid=86680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 17:59:43.072499 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4c5ac99a46f4a9895a94fa71dfb6c72)` {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 17:59:43.074474 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] RBAC: Authorization granted {{(pid=86680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 17:59:43.124978 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4c5ac99a46f4a9895a94fa71dfb6c72', 'request_id': 'req-f7162d97-f46a-48b7-9bea-a1c543d51953'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:43.130630 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4c5ac99a46f4a9895a94fa71dfb6c72', 'request_id': 'req-f7162d97-f46a-48b7-9bea-a1c543d51953'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:43.137289 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4c5ac99a46f4a9895a94fa71dfb6c72', 'request_id': 'req-f7162d97-f46a-48b7-9bea-a1c543d51953'} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:43.153141 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] The token cache is being invalidate because project a4c5ac99a46f4a9895a94fa71dfb6c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 28 17:59:43.153454 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:43.154299 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG keystone.notifications [None req-f7162d97-f46a-48b7-9bea-a1c543d51953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 28 17:59:43.156003 dv-cinder-848013-1-smb devstack@keystone.service[86680]: [pid: 86680|app: 0|req: 1463/2917] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Jun 28 17:59:43 2022] DELETE /identity/v3/projects/a4c5ac99a46f4a9895a94fa71dfb6c72 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 28 17:59:52.841155 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=28 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 17:59:53.150050 dv-cinder-848013-1-smb devstack@keystone.service[86680]: DEBUG dbcounter [-] [86680] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 18:00:46.690727 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] Authenticating user token {{(pid=86679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 28 18:00:46.692423 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 18:00:46.796313 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa1af3-25b2-4ed0-be88-90405a265aaf service neutron] Validating token access rules against request {{(pid=86679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 28 18:00:46.865587 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '266fca3c917546fa8de7b25c77c5fd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e0a9fd43ae94fee912726ba7688be82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 28 18:00:46.866285 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] REQUEST_METHOD: `GET` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 28 18:00:46.866571 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] SCRIPT_NAME: `/identity` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 28 18:00:46.866840 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 28 18:00:46.869075 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.fernet_utils [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 28 18:00:46.884356 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 28 18:00:46.886712 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e30839-e9b0-420d-8b4d-6f6e92088b38 service placement] RBAC: Authorization granted {{(pid=86679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 28 18:00:46.899136 dv-cinder-848013-1-smb devstack@keystone.service[86679]: [pid: 86679|app: 0|req: 1455/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Jun 28 18:00:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 28 18:00:56.892931 dv-cinder-848013-1-smb devstack@keystone.service[86679]: DEBUG dbcounter [-] [86679] Writing DB stats keystone:SELECT=67 {{(pid=86679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}